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(g) Method and apparatus for contour vector extraction and image en largement reduction. 



@ When an image is input, that input image is 
separated into a halftone region, such as a 
photograph, and a binary region, such as a 
character/line. Contour vector data along an 
edge of the separated binary image region is 
extracted. The contour vector is smoothed and 
isolated pixels in the binary region are removed. 
Regarding the binary image region, when the 
input image is to be enlarged or reduced and 
then output, individual coordinates in the ext- 
racted contour vector data are enlarged or re- 
duced to reproduce the binary image. 



m 
oo 

3 

to 



o 

LL 



CO 



SS8- 



<£>Iii§<£ 



o=o| 111 fo=o 



& 



3E 



fill 



ill 



3L 



Q. 
LU 



Jouve, 18, rue Saint-Denis, 75001 PARIS 



BNSDOCID. <EP 0554985A2J_> 



1 



EP 0 554 985 A2 



The present invention relates to an image proc- 
essing apparatus and a method thereof, and more 
particularly, to an image processing apparatus which 
is designed to input image data and output it to a pre- 
determined device and a method thereof. 

In conventional image processing apparatus, 
such as a facsimile machine, an image is read by an 
image scanner, and each of the pixels of the raster 
scanned image is then expressed by binary data 
which is either white or black. For the telecommuni- 
cation of the raster scanned binary image data, the 
raster scanned binary image is coded by the MH, MR 
or MMR method and then transmitted. Therefore, in 
the conventional facsimile machine, image data is in- 
ternally handled by a set of raster scanned binary pix- 
el data. When the resolution of the image read at the 
transmission side and the resolution of the reception 
side differ from each other, e.g., when the image read 
by the G3 machine (8 pel/mm in the horizontal direc- 
tion and 7.7 line/mm in the vertical direction) is trans- 
mitted to a facsimile machine which has a standard re- 
cording resolution (8 pel/mm in the horizontal direc- 
tion and 3.85 line/mm in the vertical direction), or 
when the paper size of the received image and that 
of the output image differ from each other, e.g., when 
the image received in B4 size is output to a sheet of 
recording paper having A4 size, the image data coded 
by the MH, MR or MMR method is converted into ras- 
ter scanned binary image data, and then expansion 
(enlargement) or compression (reduction) is per- 
formed by simply double-writing each of the pixels (by 
writing the same pixel at least twice) or by thinning out 
the pixels. 

However, in the above-described conventional 
image processing apparatus, when image data of a 
low resolution is recorded in the form of an image of 
a high resolution (which is internally the expan- 
sion/compression process of the image), e.g., when 
the image of 200 dpi is recorded on a sheet of record- 
ing paper of 400 dpi, the slanting contour line may be 
notched because of the simple doubling of each of the 
pixels. Furthermore, when a resolution conversion of 
about 200 % is performed, e.g., when an image of the 
G3 resolution is converted into an image having the 
G4 resolution which is 200 dpi in both the horizontal 
and vertical directions, the image may be distorted 
because of the double thinning of each of the pixels. 

Furthermore, in the conventional image process- 
ing apparatus, the quality of the original image data 
generated when an image original is read by a scan- 
ner may deteriorate due to the noises superimposed 
on the image signal generated by the scanner, that is, 
the image which is originally straight may be notched 
or black notches may appear on the white. In order to 
prevent such a deterioration in the image, attempts 
have been made to suppress the noise level of the im- 
age signal or to provide a mechanism of making the 
feed of the image original smooth. However, either of 



these methods has an deficiency. 
SUMMARY OF THE INVENTION 

5 In view of the aforementioned problems of the 

conventional techniques, an object of the present in- 
vention is to provide an image processing apparatus 
and an image processing method which enable an op- 
timum expansion/compression process to be per- 

w formed on a character/line image and a halftone im- 
age. 

Another object of the present invention is to pro- 
vide an image processing apparatus and an image 
processing method which enable a high-definition im- 
15 age to be reproduced when an input image is repro- 
duced by a predetermined device. 

Another object of the present invention is to pro- 
vide an image processing apparatus and an image 
processing method which enable a high-definition im- 
20 age to be reproduced when an input image is repro- 
duced by a predetermined device, and which allow for 
at least reproduction of the image even when there is 
a limitation to the capacity of a memory used for the 
reproduction process. 
25 Another object of the present invention is to pro- 
vide an image processing apparatus and an image 
processing method which enable an objective image 
or an objective region in an image to be determined 
as a halftone image or a binary image on the basis of 
30 contour vector of the image extracted during image 
processing without providing a circuit for determining 
whether the input image is a halftone image or a bi- 
nary image or which region in the input region is a 
halftone image or an binary image. 
35 Another object of the present invention is to pro- 

vide an image processing apparatus and an image 
processing method which enable enable an excellent 
image to be generated even when the expan- 
sion/compression process is performed on the image 
40 and which enable an image to be output in a desired 
size with respect to each of the axes of an orthogonal 
coordinate system. 

Another object of the present invention is to pro- 
vide an image processing apparatus and an image 
45 processing method which enable a high-definition im- 
age to be output by a predetermined device and which 
enable a reduction in the processing ability of the de- 
vice to be restricted as much as possible. 

Another object of the present invention is to pro- 
so vide an image processing apparatus and an image 
processing method which enable notch removal to be 
performed while taking various conditions, such as an 
image input resolution orthe desire of a user, into con- 
sideration. 

55 Other features and advantages of the present in- 
vention will be apparent from the following description 
taken in conjunction with the accompanying draw- 
ings, in which like reference characters designate the 
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same or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a first embodiment of 5 
an image processing apparatus according to the 
present invention; 

Figs. 2A through 2C are flowcharts showing the 
transmission process executed in the first em- 
bodiment; 10 
Figs. 3A through 3C are flowcharts showing the 
reception process executed in the first embodi- 
ment; 

Fig. 4 is a flowchart showing the copying process 
executed in the first embodiment; 15 
Fig. 5 is a block diagram of a contour extraction 
circuit of the first embodiment; 
Fig. 6 illustrates the unit of contour vector extrac- 
tion in the first embodiment; 

Fig. 7 shows a horizontal rough contour vector ta- 20 
ble in the first embodiment; 
Fig. 8 shows a vertical rough contour vector table 
in the first embodiment; 

Fig. 9 shows an example of a vector table in the 
first embodiment; 25 
Fig. 10 is a block diagram of a smoothing/coordin- 
ate transformation circuit 109 in the first embodi- 
ment; 

Fig. 11 shows an example of a processing of a 
first smoothing circuit in the first embodiment; 30 
Fig. 12 shows another example of a processing 
of the first smoothing circuit in the first embodi- 
ment; 

Figs. 13A and 13B show another example of a 
processing of the first smoothing circuit in the 35 
first embodiment; 

Figs. 14Aand 14B show another example of a 
processing of the first smoothing circuit in the 
first embodiment; 

Fig. 15 shows another example of a processing 40 
of the first smoothing circuit in the first embodi- 
ment; 

Figs. 1 6A through 1 6C show another example of 
a processing of the first smoothing circuit in the 
first embodiment; 45 
Figs. 17A and 17B show another example of a 
processing of the first smoothing circuit in the 
first embodiment; 

Figs. 1 8A through 1 8C show another example of 

a processing of the first smoothing circuit in the so 

first embodiment; 

Fig. 19 shows another example of a processing 
of the first smoothing circuit in the first embodi- 
ment; 

Fig. 20 is a circuit diagram of an inside f illing-in 55 

circuit in the first embodiment; 

Fig. 21 shows an example of an input image; 

Fig. 22 shows outline vector data which is based 



on the image of Fig. 21; 

Fig. 23 shows an example of an input image 
which is used to illustrate the contour vector ex- 
traction principle in the first embodiment; 
Fig. 24 shows the transition of the horizontal and 
vertical rough contour vectors based on the input 
image shown in Fig. 23; 

Fig. 25 illustrates the principle of the correction 
process performed when an original is read in an 
inclined way; 

Fig. 26 is a block diagram of a second embodi- 
ment of an image processing apparatus accord- 
ing to the present invention; and 
Fig. 27 is a flowchart showing the operation of 
the image processing apparatus of Fig. 26. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Embodiments of the present invention will be de- 
scribed with reference to the accompanying draw- 
ings. 

Afirst embodiment of the presentinvention will be 
described. 

< Structure of Apparatus > 

Fig. 1 is a block diagram which illustrates an im- 
age processing and communication apparatus ac- 
cording to a first embodiment Referring to Fig. 1 , ref- 
erence numeral 101 denotes an image scanner for 
A/D converting image data read by a photoelectric 
conversion device such as a CCD in the sequential 
order to raster scanning operation. The digital multi- 
value data converted by A/D conversion is binarized 
so as to transmit binary raster image data to a bus 
A11 5. Binary raster image data transmitted to the bus 
A is temporarily stored in a memory A103. 

Reference numeral 102 denotes an image region 
separation circuit which receives raster scanned mul- 
ti-value data (for example, 8 bit/pixel in the case 
where 256 gradations for one pixel) supplied from the 
image scanner 101, and separates half tone regions 
and character and line regions from one another so 
as to cause an image region separation table (to be 
described later) for each image region to be formed 
in the memory A103. It should be noted that the bi- 
nary images such as the characters and lines and the 
half tone images can be discriminated by examining 
the value of supplied multi-value data. Since a binary 
image usually has only white (the lowest density) and 
black (the highest density), the density is rapidly 
changed in the regions (edges) in which the two 
states are position adjacently. On the contrary, the 
density is changed moderately in the half tone image 
because the density is gradually changed. Hence, a 
discrimination can be made as to whether or not the 
subject pixel is positioned in the edge of the binary 
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image or in the edge of the half tone image. Inciden- 
tally, the technology to distinguish the binary image 
such as the character and lines and the halftone im- 
age has a known technology, and it can be realized 
by another operation. Another structure may be em- 
ployed in which the type or the like of the read original 
document may be instructed by an operation. 

Reference numeral 107 denotes an outline ex- 
traction circuit which reads binary raster image data 
stored in the memory A103 and reads, if necessary, 
the image separation table for separating the image 
regions so as to form outline coordinate data strings 
in a memory B111. 

Reference numeral 108 denotes a coding/decod- 
ing circuit which reads binary raster image data stored 
in the memory A103, and encodes and compresses 
the MH, MR or MMR binary image so as to cause the 
memory B111 to store the encoded image data in the 
case where the encoding process is performed. In 
the case where the decoding process is performed, 
the coding/decoding circuit 1 08 receives encoded im- 
age data stored in the memory B111 so as to transmit 
decoded binary raster image data to the memory 
A103. 

Reference numeral 1 09 denotes a smoothing and 
coordinate conversion circuit which receives the out- 
line coordinate data strings stored in the memory 
B111 so as to perform a variety of coordinate conver- 
sion processes (multiplication with a ratio of expan- 
sion or compression and interchanging x- with y-co- 
ordinates and the like) and the smoothing process for 
smoothing the rough (jagged) portion of the outline 
generated at the time of the enlargement Then, the 
smoothing and coordinate conversion circuit 109 
forms converted outline coordinate data strings in the 
memory B111. 

Reference numeral 113 denotes a communica- 
tion control circuit (CCU) which receives image data 
(the outline coordinate data strings, or image encod- 
ed data and, if necessary, the region separation ta- 
ble) stored in the memory B111 so as to transmit im- 
age data to the data line. The communication control 
circuit (CCU) 113 causes image data received 
through the data line to be stored in the memory 
B111. 

Reference numeral 110 denotes a binary image 
reproducing circuit which receives the outline coor- 
dinate data strings stored in the memory B111, and 
which draws an outline in the memory A103 in accor- 
dance with outline coordinate data so as to form a bi- 
nary raster image (a bit map image). 

Reference numeral 104 denotes an inside draw- 
ing circuit which receives the binary raster image (the 
bit map image) in the memory A103 formed by draw- 
ing the outline, and which draws the closed region 
surrounded by the outline so as to transmit the thus 
formed image to an FIFO memory 105. 

The FIFO memory 105 again horizontally and 



BNSDOCID: <EP 055496SA2J_> 



vertically synchronizes with the printer so as to trans- 
mit binary raster image data to the printer 106. 

Reference numeral 1 06 denotes a printer such as 
an LBP printer which receives binary raster image 
5 data, which has been again synchronized with the 
FIFO 105, so as to record image data on a recording 
paper sheet. 

transmission Process> 

10 

The flow of image data in the image processing 
and communication apparatus according to this em- 
bodiment, that is, the transmission operation will now 
be described with reference to a flow chart shown in 
15 Figs. 2A to 2C, the receiving operation will be descri- 
bed with reference to a flow chart shown in Figs. 3A 
to 3B, and the copying operation will be described 
with reference a flow chart shown in Fig. 4. 

In step S1, an image is, as binary raster image 
20 data, read by the image scanner 101 so as be trans- 
ferred and stored in the memory A103. In the case 
other than the immediate transmission, that is, if the 
transmission of image data is not performed imme- 
diately, image data stored in the memory A103 is en- 
25 coded and compressed by the coding/decoding cir- 
cuit 1 08, the encoded and compressed data is stored 
in the memory B11 1 as an image file, and it is decod- 
ed at the time of transmission before it is developed 
in the memory A103 as a binary raster image as 
30 shown in steps S9, S10 and S11, so that the memory 
is effectively utilized. Simultaneously with the storage 
of the binary raster image, multi-value raster image 
data obtained by the image scanner is transmitted to 
the image region separation circuit 102. The image 
35 region separation circuit 102 discriminates whether 
the subject portion is the character and line region or 
the half tone region for each block (a predetermined 
region) so as to form, in the memory A103, a region 
discrimination table showing the characteristics of the 
40 image region. The encoded image data file, which has 
been stored, and the region discrimination table file, 
of course, have the same file attribute and they are 
taken out when they are required. 

In the case where it is apparent that pseudo half 
45 tone is used in accordance with whether or not a se- 
lection button (a halftone button provided in an oper- 
ation portion omitted from illustration) for selecting 
whether or not a pseudo half tone process is per- 
formed at the time of the binary coding process is de- 
50 pressed, the image region separation table for each 
image region is not formed, but only the image attri- 
bute showing whether the pseudo half tone or the 
character/line is recorded by a quantity of one page. 
In step S3, the region discrimination table show- 
55 ing whether the character/line region or the pseudo 
half tone region is read from the memory A103. If the 
subject region is the character/line region, the flow 
proceeds to step S4. If it is the half tone region, the 

4 
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flow is branched to step S12. If the discrimination is 
made that the subject region is the half tone region 
and the flow proceeds to step S12, a discrimination 
is made that expansion/compression must be per- 
formed, the expansion/compression process for each 
raster, which is the process of expanding/compress- 
ing the binary raster image, is performed similarly to 
the convention G3 or G4. Then, coding so as to be 
adaptable to the data line is performed, and image 
data is transmitted. 

If the image region discrimination table is trans- 
mitted at this time, the region discrimination table 
stored in the memory A03 is transferred to the mem- 
ory B111 so as to be transmitted. 

If a discrimination is made in step S4 that outline 
coordinate data strings can be transmitted because 
the receiving side has a function of reproducing the 
binary raster image from the outline coordinate data 
strings, the aforesaid fact is notified from the receiv- 
ing side to the transmission side, and the flow pro- 
ceeds to step S5. If the receiving side is constituted 
by only the function of conventional G3 or G4 and 
therefore it can not receive the outline coordinate data 
strings, the flow proceeds to step S16. In step S16, a 
discrimination is made as to whether or not the expan- 
sion/compression must be performed. If it must be 
performed, the flow proceeds to step S17 in which 
the expansion/compression process is performed in 
accordance with the outline coordinate data strings. 
If it does not need to be performed, the flow proceeds 
to step S23 in which the coding process is performed 
before image data is transmitted. 

In step S17, binary raster image data stored in 
the memory A1 03 is supplied to the outline extraction 
circuit 102, and binary raster image data is converted 
into the outline coordinate data strings. Then, the out- 
line coordinate data strings are stored in the memory 
B111. In step S18, a discrimination is made as to 
whether or not a process of enlarging the outline co- 
ordinate data strings stored in the memory B1 11 must 
be performed. If the enlargement process must be 
performed, the flow proceeds to step S19. tf it does 
not need to be performed, the flow proceeds to step 
S20. 

In step S19, the outline coordinate data strings 
supplied from the memory B111 are received so as to 
perform an outline smoothing process to be descri- 
bed later is performed, and then the flow proceeds to 
step S20. In step S20, each coordinate value is mul- 
tiplied by a ratio of expansion/compression so as to be 
converted into coordinate values adapted to the 
transmissible resolution. In step S21, the converted 
outline coordinate data strings are transmitted to the 
binary image reproducing circuit 111 from the mem- 
ory B111 so as to draw the outline on the bit map im- 
age stored in the memory A1 03. In step 22, the image 
bit map, the outline of which has been drawn by the 
inside drawing circuit 104, is taken for each raster so 



as to develop it in the memory A1 03 as a binary raster 
image which has been subjected to the inside drawing 
process. 

In step S23, the aforesaid image data is coded so 

5 as to be adapted to the communication mode is per- 
formed by the coding/decoding circuit 108, so that 
coded data is transmitted to the memory B111. If the 
G4 mode is employed, coded image data, which has 
been transmitted to the memory B111, is transmitted 

10 by the CCU 113. In the case of the G3 mode, a MO- 
DEM (omitted from the illustration) is used to transmit 
the coded image data. 

Processes on and after step S5 will now be de- 
scribed. If the image region to be transmitted is the 

15 character/line image and the receiving side is able to 
receive outline coordinate data, the flow proceeds to 
step S5. Image data transferred as the character/line 
region to the outline extraction circuit 107 from the 
memory A103 is subjected to a process in which all 

20 of its pixels are scanned while updating a rough out- 
line coordinate data table, and image data is finally 
converted into the outline coordinate data strings 
which are stored in the memory B111. In step S6, a 
discrimination is made as to whether or not the ex- 

25 pansion/compression of image data converted into 
the outline coordinate data strings must be per- 
formed. If the expansion/compression must be per- 
formed, the flow proceeds to step S7 in which image 
data stored in the memory B111 is transferred to the 

30 to the smoothing/coordinate conversion circuit 109 so 
as to multiply the coordinate values by a ratio of ex- 
pansion/compression. If necessary, the coordinate 
strings are traced so as to leave a featured point in the 
outline coordinate data strings. If the enlargement 

35 process is performed, the smoothing conversion op- 
eration is performed. If a discrimination is made as a 
result of tracing that image can be restored by the 
smoothing process, the effective number of digits of 
the coordinate value of coordinate data is decreased, 

40 so that the quantity of data is compressed. Then the 
outline coordinate data strings, the coordinates of 
which have been converted by the smoothing/coor- 
dinate conversion circuit 109, are returned to the 
memory B111 . In step S8, image data, the transmis- 

45 sive resolution and the receipt resolution are made 
coincide with each other, is transmitted by the CCU 
113. If the G3 mode is employed, it is similarly trans- 
mitted by a MODEM (omitted from illustration). 
If occurrence of a communication error is taken 

so into consideration, the outline coordinate data strings 
can be transmitted and received by correcting a pro- 
tocol error and by again transmitting the image which 
has encountered an error in the case where the im- 
age is communicated as the outline coordinate data 

55 if the G4 CCU is employed as the communication ap- 
paratus. In the case where the G3 communication ap- 
paratus is employed which uses the MODEM, data 
transmission and receipt must be performed by using 
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HDLC in the ECM. Therefore, the outline coordinate 
data strings are transmitted and received in accor- 
dance with the G3 procedure through the MODEM by 
using a conventional telephone line, a forced ECM 
mode is realized, and switching to an image data 
transmission, which uses the conventional MH and 
MR codes, is performed and the conventional G3 
mode is employed to communicate the image if the 
re-transmission of the ECM takes place frequently 
due to the state of the data line, or if the ECM trans- 
mission and receipt cannot be performed. 

<Receiving Process> 

The receipt process to be performed by the ap- 
paratus according to this embodiment will now be de- 
scribed with reference to a flow chart shown in Figs. 
3 A and 3B. 

In the receipt operation to be performed in step 
S101, the CCU 113 or a MODEM (omitted from illus- 
tration) is used to receive image data. The received 
image is MH, MR or G4 coded image data formed in 
accordance with the conventional G3 procedure or 
the outline coordinate data strings transmitted by the 
image processing and communication apparatus ac- 
cording to this embodiment Received image data is 
temporarily stored in the memory B111. 

In step S102, a discrimination is made as to 
whether or not received image data is the outline co- 
ordinate data strings transmitted by an apparatus of 
the same type as the image processing and commu- 
nication apparatus according to this embodiment 

If a discrimination is made that received image 
data is image data transmitted by the apparatus ac- 
cording to this embodiment, the flow branches to step 
S114. If a discrimination is made that it is MH, MR, or 
MMR coded data received from an ordinary facsimile 
apparatus, the flow proceeds to step S103. 

In step S114, a discrimination is made as to 
whether or not the expansion/compression of the re- 
ceived image data must be performed. If a discrimin- 
ation is made that the expansion/compression must 
be performed, the flow proceeds to step S107 in 
which an expansion/compression process, in which 
the outline coordinate data strings are used, is per- 
formed. If the expansion/compression process does 
not need to be performed, the flow proceeds to step 
S109 in which a discrimination is made as to whether 
or not the scanning directions coincide with each 
other. Then, image data is again converted from the 
outline coordinate data strings to binary raster image 
data, and image data is printed out. 

If a discrimination is made that received image 
data is MH, MR or MMR-coded image data and the 
flow therefore proceeds to step S103, received data 
is transferred to the coding/decoding circuit 108 in 
which it is decoded to binary raster image data, and 
decoded data is stored in the memory A1 03. In next 



step S104, a discrimination is made that the expan- 
sion/compression must be performed when received 
image data is printed out. If a discrimination is made 
that the expansion/compression must be performed, 

5 the flow proceeds to step S105. If it does not need to 
be performed, the flow proceeds to step S113 in 
which binary raster image data is transferred from the 
memory A103 to the FIFO 105 so as to be again syn- 
chronized with the printer 1 06, and then, binary raster 

w image data is printed out 

In step S105, a discrimination is made from the 
region discrimination (the image attribute or the re- 
gion discrimination table) that received image data is 
a pseudo half tone image or a character/line image. 

15 Image data blocks discriminated to be the pseudo half 
tone image data are subjected to a process to be per- 
formed in step S116 in which the image blocks are 
transferred to the raster image expansion/compres- 
sion circuit 114 so that the image blocks are expand- 

20 ed/compressed as a binary raster image. Image 
blocks discriminated to be the character/line region is 
transferred to the outline extraction circuit 107 in 
which the image blocks are, as outline coordinate 
data strings to be described later, subjected to a ex- 

25 pansion/compression process. 

In step S106, binary raster image data of a char- 
acter/line image stored in the memory A103 is trans- 
ferred to the outline extraction circuit 107 in which bi- 
nary raster image data is converted into outline coor- 

30 dinate data strings so as to be stored in the memory 
B111. 

In step S107, a discrimination is made as to 
whether or not either the sub-scanning or the main 
scanning is subjected to the enlargement process. If 

35 it is subjected to the enlargement process, the flow 
proceeds to step S115 in which the outline coordinate 
data strings stored in the memory B111 are transfer- 
red to the smoothing/coordinate-conversion circuit 
109 so as to perform a first smoothing process and 

40 a second smoothing process in which tracing pattern 
matching of the outline coordinate strings is per- 
formed, so that outline coordinate data other than 
corner point is smoothed. As a result of this process, 
rough portions in diagonal lines formed at the time of 

45 the enlargement process can be smoothed. The term 
"corner point" used hereinbefore will be described lat- 
er in detail but briefly it is meant a point, the coordin- 
ate position of which is not changed even it has been 
subjected to the smoothing process. 

50 In step S108, each of the outline coordinate data 
strings or the outline coordinate data strings, the out- 
lines of which have been smoothed, is multiplied with 
the ratio of expansion/compression, so that each co- 
ordinate string is converted into coordinate data 

55 which is adapted to the resolution of the printed out- 
put 

In step S109, a discrimination is made as to 
whether or not the image data scanning direction is 
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different from the image scanning direction at the 
time of the recording process in the case where, for 
example, a B5 size image read longitudinally is out- 
putted as a horizontal A4 size image. In this case, the 
flow proceeds to step S11 0 in which the x-coordinate 
and the y-coordinate of the outline coordinate data 
strings are transposed and the result of the transpos- 
tion is stored in the memory B1 11. If the transposition 
of the coordinates does not need to be performed, 
the read image is as it is stored in the memory B111. 

In step S111, the outline coordinate data strings, 
which are stored in the memory B111, and the pixel 
density of each of which has been converted, are re- 
ceived by the binary image reproducing circuit 110, 
and a portion of the memory A1 03 is used to store the 
bit map image of the output image so as to draw the 
outline of the bit map image. 

In step S112, image data, the outline of which has 
been drawn, is, for each raster, taken out from the 
memory A103, and the portion surrounded by the 
outline is drawn by the inside drawing circuit 104, and 
image data is transferred to the FIFO 105. At this 
time, outline coordinate data is again converted into 
binary raster image data, in the case where the flow 
proceeds from step S104 or step S105 to step $113, 
the binary raster image stored in the memory A103 
is transferred to the FIFO 500 so as to be printed. 

Binary raster image data transferred to the 
FIFO105 is again synchronized with the printer 106 in 
step S113 so as to be outputted from the printer 106 
as a raster image. 

<Copying Process> 

The copying process will now be described with 
reference to a flow chart shown in in Fig. 4. 

In step S201 , an original document is read. In this 
case, the storage of the file does not need to be per- 
formed as is in the case of the immediately copying 
operation, the flow proceeds from step S202 to step 
S213 in which image data outputted from the image 
scanner 101 is transferred to the FIFO 105 via the 
memory A103 so as to be printed out. The reason why 
it is temporarily stored in the memory A1 03 lies in that 
the difference between the speed of the image scan- 
ner and that of the printer must be absorbed. If the re- 
cording speed can be changed as in the case of a 
thermal printer, image data is directly transferred to 
the FIFO 105 so as to be outputted as described 
above. If the immediately copying operation is per- 
formed, the reading resolution of the image scanner 
1 01 is made to be the same as that of the output from 
the printer, resulting in that the necessity of perform- 
ing a process to be eliminated and that a necessity 
lies in that the aforesaid transferring process is per- 
formed. 

If an instruction is made to perform copying after 
image data has been stored as a f Be in place of the 



immediately copying operation, the flow proceeds to 
step S203 in which coding and compressing opera- 
tion is performed in order to improve the efficiency of 
memorizing the image file. In this embodiment, the 

5 binary raster image stored in the memory A103 is 
transferred to the coding/decoding circuit 108 so as 
to be converted into an MH code or the like, so that 
it is transferred to and stored in the memory B111. 
The coding and compressing process may, of course, 

10 be performed by any of a variety of compression 
methods other than the MH coding method. A com- 
pressing method peculiar to the apparatus according 
to the present invention may be employed. Image 
data stored temporarily is again read out from the 

75 memory B1 11 at the time of the printing out operation 
as shown in steps S204 and S205, and is decoded by 
the coding/decoding circuit 1 08 so as to be developed 
in the memory A103 as binary raster image data. 
In step S206, a discrimination is made as to 

20 whether or not the expansion/compression of the 
stored image file must be performed. The aforesaid 
discrimination is made on the basis of a fact that the 
size of the original document image is different from 
that of a recording medium of the apparatus or a fact 

25 that the expansion/compression is instructed by an 
operator. If the expansion/compression does not 
need to be performed, the flow proceeds to step 
S213 in which image data is, for each raster, transfer* 
red to the FIFO 105, is again synchronized with the 

30 printer 106 so as to be printed out. If the expan- 
sion/compression process is performed, the flow pro- 
ceeds to step S207 in which, as described in the 
transmission process, a discrimination is made on the 
basis of the region discrimination table whether the 

35 stored image file is a pseudo half tone image or a 
character/line image. In step S215, if the image file is 
the pseudo half tone image, the decoded image is 
transferred to the raster image expansion/compres- 
sion circuit 114 in which the expansion/compression 

40 is performed while maintaining the state of the binary 
raster image before it is returned to the bit map image 
memory of the memory A103. In step S215, if a dis- 
crimination is made in step S207 that the image is the 
character/line image, the flow proceeds to step S208 

45 in which the blocks discriminated to be the character- 
Aline regions are sequentially transferred to the out- 
line extraction circuit 107, so that binary raster image 
data is converted into the outline coordinate data 
strings which sre stored in the memory B111 as the 

50 outline coordinate data strings. In the case where an 
enlargement process is, as described in the receiving 
process, performed in which image data stored with, 
for example, the G3 standard resolution (main scan- 
ning: 8 pel/mm, sub-scanning: 3.85 pel/mm) isoutput- 

55 ted to a printer, the resolution of which is 400 dpi, the 
first and second smoothing processes to be descri- 
bed later are performed in the smoothing/coordinate- 
conversion circuit in order to perform the smoothing 
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process in step S214. 

In step S210, each coordinate of the outline co- 
ordinate data strings or the smoothed outline coordin- 
ate data strings is multiplied by the ratio of expan- 
sion/compression so as to be converted into the out- 
line coordinate data adaptable to the resolution and 
the size of the printed-out image. In step S211 , image 
data converted into the outline coordinate data 
strings of the printed-out image is transferred to the 
binary image reproducing circuit 110, so that the out- 
line is drawn in the bit map image memory of the 
memory A103 by the binary image reproducing circuit 
110. In step S212, binary raster image data, which 
has been formed in the memory A1 03, and the outline 
of which has been drawn, is, for each raster, read out 
so as to be transferred to the FIFO 105 in which it is 
synchronized with the printer as shown in step S213 
so as to be printed out. 

Although the aforesaid processes are described 
sequentially, the decoding process, the outiine ex- 
traction process, the smoothing process, the coordin- 
ate conversion process, the binary image reproduc- 
ing process and the inside drawing process can be 
performed in parallel by performing each process for 
each block, resulting in the through-put of the system 
to be improved. Among the processes according to 
his embodiment, a process, which causes a large load 
to be borne, may be performed during waiting in place 
of performing it at the time of the transmission and re- 
ceiving processes. 

<Each of Processing Circuits> 

In order to describe the resolution conversion in 
each processing blocks by using the outiine coordin- 
ate strings, the outline extraction circuit 107, the 
smoothing/coordinate-conversion circuit 109, the bi- 
nary image reproducing circuit 110 and the inside 
drawing circuit 104 will now be described with refer- 
ence to the drawings. 

<Outline Extraction Circuit> 

The outline extraction circuit 107 performs the 
process while observing a subject pixel 161 and ad- 
jacent 8 pixels (A, B, C. D, 0, 1, 2, and 3) of the binary 
image as shown in Fig. 6. The subject pixel is sequen- 
tially shifted by one pixel so as to process all of the 
rasters, so that the overall image is processed. The 
specific operation is performed as follows. The out- 
line extraction process according to this embodiment 
is performed in such a way that a black region is posi- 
tioned to the right in the direction of a vector to be ex- 
tracted. 

The start point and the end point of a rough out- 
line vector to be extracted are, in both the main scan- 
ning direction and the sub-scanning direction, posi- 
tioned at an intermediate position between two pix- 



els. Furthermore, the central position at which the 
pixel is present is expressed by a plus integer in both 
the main scanning direction and the sub-scanning di- 
rection and the position of the pixel is expressed by 
5 two-dimensional coordinates. In the case where the 
position of a subject pixel of an image having a size 
of 1728 pixels in the main scanning direction and 
2287 pixels in the sub-scanning direction is [3, 7](it is 
meant a third pixel in the seventh raster), the rough 
w outline vector coordinate strings surrounding the sub- 
ject pixel are (2.5, 6.5), (3.5, 6.5), (3.5, 7.5), and (2.5, 
7.5) when viewed clockwise. That is, they are the co- 
ordinate positions of the four corners while assuming 
that the subject pixel is in the form of a rectangular. 
15 It should be noted that the rough outline vectors are, 
while assuming that the aforesaid four points are a, 
b, c and d and expressing a vector by a form of x -+ 
y, a r-> b, b c, c -» d, and d -» a. 

Fig. 5 is a block diagram which illustrates the in- 
20 ternal structure of the outline extraction circuit 107. 
Reference numeral 150 denotes an input control cir- 
cuit which receives binary raster image data stored in 
the memory A103 and which outputs it as serial data. 
It should be noted that the aforesaid data is synchron- 
25 ized with a horizontal and vertical synchronizing sig- 
nals (omitted from illustration) and is outputted as ser- 
ial data. Reference numerals 151 and 152 denote 
FIFO memories for taking out pixel data for three lines 
in the vertical direction, the FIFO memories 151 and 
30 1 52 delaying pixel data, supplied while being formed 
into serial data, by a degree of one I ine. Reference nu- 
meral 153 denotes a 3 x 3 shift register group which 
receives an output from the input control circuit 105, 
an output from the FIF0 1 51 which is delayed by a de- 
35 gree of one line, and an output from the FIFO 152 
which is delayed by a degree of two lines, so as to se- 
quentially receives data for three lines. The received 
binary image data for three lines is sequentially shift- 
ed by one pixel so as to transmit (9-bit) data of 3 x 3 
40 pixels as shown in Fig. 6 to a decoder 154. The de- 
coder 154 outputs 4-bit numerical data which shows 
the state of the surrounding 8 pixel except for the sub- 
ject pixel (x shown in Fig. 6) and the value of the sub- 
ject pixel to an outline extraction computing circuit 
45 1 57. The state of the 8 pixels used hereinbefore is in- 
formation showing the state of the subject pixel, for 
example, whether or not the subject pixel is posi- 
tioned on the edge of a binary image. If the subject 
pixel is positioned on the edge, the aforesaid informa- 
50 tion shows the direction of a white region (binary data 
is "0") among the four directions. 

Reference numeral 155 denotes a main scanning 
counter for outputting the position of the subject pixel 
in the main scanning direction to the outline extrac- 
55 tion computing circuit 157. Reference numeral 156 
denotes a sub-scanning counter for outputting the 
position of the subject pixel in the sub-scanning direc- 
tion to the outline extraction computing circuit 157. 

8 
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The outline extraction computing circuit 157 ex- 
tracts the rough outline vector from the output value 
from the decoder 154 so as to make and update a ta- 
ble containing the coordinates of the starting point of 
each rough outline vector and item No. information of 
another rough outline vector flowing in the aforesaid 
rough outline vector (the end point of which is the 
start point of the aforesaid vector) and another rough 
outline vector (the starting point of which is the end 
point of the aforesaid vector) flowing out from the 
aforesaid rough outline vector. 

The aforesaid rough outline vector will now be de- 
scribed. 

In the first embodiment, a vector along the edge 
of the binary image is extracted. In the case where 
the vector is extracted while considering the pixel lev- 
el, there are two types of the vectors, that is, vertical 
directional vectors and horizontal directional vectors. 
In other words, the edge of the binary image is an ag- 
gregation of a vertical directional vector and a hori- 
zontal directional vector. When a certain vertical vec- 
tor is paid attention although the vector size is varied, 
a horizontal vector is, wit hout exception, connected to 
both of the starting point and the end point of the sub- 
ject vertical vector. That is, a vertical vector is held be- 
tween horizontal vectors. On the contrary, a horizon- 
tal vector is held between vertical vectors. When a 
certain vector is paid attention, a vector which is con- 
nected to the starting point of the subject vector, that 
is, a vector, the end point of which is the starting point 
of the subject vector, is called an inflow vector in this 
embodiment, while a vector, the starting point of 
which is the end point of the subject vector, is called 
an outflow vector. By obtaining the relationship of the 
connection between the vectors, the outline along 
the edge of the subject binary image can be speci- 
fied. Each vector is given unique No. so as to specify 
the vector, and the aforesaid No. shows the relation- 
ship of the connection between vectors. The No. 
which specifies each vector, is called "Item No." here- 
inafter. 

Fig. 7 illustrates the horizontal directional rough 
outline vector and Fig. 8 illustrates the vertical direc- 
tional rough outline vector, which are, in the form of 
tables, stored in the memory B111. 

Referring to Figs. 7 and 8, reference numeral 171 
denotes a counter which shows the item No. of the 
horizontal directional rough outline vector and the 
count of which is increased by one when the horizon- 
tal rough outline vector increases by one (newly 
found). Reference numeral 172 denotes a region for 
use to record the x-coordinate of the starting point of 
the horizontal directional rough outline vector. Refer- 
ence numeral 173 denotes a region for use to record 
the y-coordinate of the starting point of the horizontal 
directional rough outline vector. Reference numeral 
174 denotes a region for storing the item No. of the 
vertical vector (outflow vector) to be connected to the 



starting point of the aforesaid horizontal vector. Ref- 
erence numeral 175 denotes a region for storing the 
item No. of the vertical vector (outflow vector) to 
which the end point of the aforesaid horizontal vector 
5 is connected. Since the two vectors connected to the 
horizontal vector are vertical vectors as described 
above, the regions 174 and 175 store the item No. of 
each vertical vector to be connected to the horizontal 
vector. 

10 The aforesaid idea is similarly adapted to the ta- 
ble forthe vertical vectors shown in Fig. 8. That is, ref- 
erence numeral 181 denotes a counter which shows 
the item No. of the vertical directional rough outline 
vector and the count of which is increased by one 

15 when the vertical rough outline vector increases by 
one. Reference numeral 182 denotes a region for use 
to record the x-coordinate of the starting point of the 
vertical directional rough outline vector. Reference 
numeral 1 83 denotes a region for use to record the y- 

20 coordinate of the starting point of the vertical direc- 
tional rough outline vector. Reference numeral 184 
denotes a region for storing the item No. of the hori- 
zontal vector (inflow vector) to be connected to the 
starting point of the aforesaid vertical vector. Refer- 

25 ence numeral 185 denotes a region for storing the 
item No. of the horizontal vector (outflow vector) to 
which the end point of the aforesaid vertical vector is 
connected. 

The rough outline vector is, upon occasion, add- 
30 ed to the aforesaid horizontal and vertical directional 
rough outline vector tables, and the contents of the 
same are updated whenever one pixel is processed, 
so as to be completed as the horizontal and vertical 
directional rough outline vector tables for an image of 
35 one frame after the process of one frame has been 
completed. 

By sequentially checking the item Nos. of the in- 
flow vector and two output vectors of the horizontal 
and vertical directional rough outline vector tables 

40 shown in Figs. 7 and 8, a table of a rough outline vec- 
tor coordinate as shown in Fig. 9 is made which ex- 
presses the total number of the outlines, the total 
number of the outlines for each outline (closed loop 
of the outline, and the x- and y- coordinates of each 

45 point included by the outline. Thus, a series of the 
processes is completed here. 

If a discrimination is made that the subject pixel 
is not positioned at the edge of the image, the ar- 
rangement may be made in such a way that the ad- 

so dition and updating processes are not performed in 
the aforesaid state because the table is not substan- 
tially updated, resulting in the processing speed to be 
raised. 

The processing and updating processes of the 
55 horizontal and vertical directional rough outline vector 
tables wilt now be specifically described. In order to 
simplify the description, assumptions are made that 
the read image has a size of 6 x 5 pixels and that a 
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single pixel A and continued pixels B and C present 
as shown in Fig. 23. The coordinate positions (the 
rough outline vector coordinates) of the four corners 
of the pixel A are (2.5, 2.5), (2.5, 3.5), (1 .5, 3.5), and 
(1 .5, 2.5) when viewed clockwise from the upper right 
position. The coordinate positions of the pixels B and 
C need no explanation. 

Reading and processing the aforesaid image, a 
first black pixel is detected on the third raster at the 
second pixel. At this time, all of the pixels surrounding 
the subject pixel (pixel A) are white ("0") pixels and, 
therefore, four vectors are present in such a way that 
two vectors are present in the horizontal direction and 
two vectors are present in the vertical direction. Since 
this embodiment is arranged in such a manner that 
the item No. is given to a new rough outline vector 
whenever it is generated, item Nos. 0 and 1 are given 
in both the horizontal and vertical directions in this 
case. Therefore, the horizontal and vertical vector ta- 
bles are as shown in Fig. 24A. The way of use of the 
aforesaid tables will now be again described. 

For example, an attention is paid to a horizontal 
vector which is given item No. "0". A vertical vector, 
the item No. of which is T, flows in the starting point 
(the upper left corner of the pixel A) of the subject 
vector, while a vertical vector, the item No. of which 
is "0", flows out from the end point of the subject pixel. 
Incidentally, the item No. of each vector may be con- 
sidered to be an offset address which shows the pos- 
ition in the table at which the vector is stored. That is, 
it can be understood that data of the vertical vector, 
which flows in/flows out to and from the horizontal 
vector, the item No. of which is "0", is present at off- 
sets "0" and "1° of the vertical vector table. 

Referring back to Fig. 23, the process is shifted 
from the pixel A to the right pixel, resulting in that no 
process is performed and the process proceeds to 
the next pixel B because the subject pixel is white. 

If an attention is paid to the pixel B, it can be un- 
derstood that vectors are present in the upward and 
downward direction and on the right of the subject pix- 
el except for the right of the same. Furthermore, the 
coordinate positions of the upper left corner of the 
subject pixel can be defined to be the starting point 
of the horizontal vector and those of the lower left cor- 
ner of the subject pixel can be defined to be the start- 
ing point of the vertical vector. Hence, the aforesaid 
points can be newly registered into the horizontal and 
vertical vector tables. However, coordinates (3.5, 2.5) 
of the upper left corner of the subject pixel is stored 
as the starting point of a horizontal vector, the item 
No. of which is T, and coordinates (3.5, 3.5) of the 
lower left corner is stored as the starting point of a 
vertical vector, the item No. of which is m 2 m because 
item No. "1 " or less are used in both of the vertical and 
horizontal directions. If an attention is paid to a hori- 
zontal vector the item No. of which is "2", a vertical 
vector, the item No. of which is "2", flows in the afore- 
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said horizontal vector. Since a vertical vector cannot 
be discriminated at this point (a pixel continued in the 
horizontal direction is present), a mark is given so as 
to be distinguished. The aforesaid operation must be 
5 similarly performed when the vertical vector, the item 
No. of which is "2" is treated. That is, a mark is given 
to a corresponding position in the table because a 
horizontal vector which flows in the vertical vector, 
the item No. of which is "2", cannot be discriminated. 
10 Thus, each table is updated as shown in Fig. 24B. 

When the process proceeds to pixel C, coordin- 
ate positions (5.5. 3.5) and (5.5, 2.5), which are the 
start points of vectors, are generated. Therefore, the 
table is updated by the aforesaid coordinate posi- 
ts tions. Since the vertical vector, which flows out from 
the horizontal vector, the item No. of which is "2", is 
a vertical vector which has been newly registered and 
the item No. of which is "3", the item No. of this vert- 
ical vector is written on the horizontal vector. Similar- 
20 ly, the vertical vector is subjected to the updating 
process. Thus, each table is updated as shown in Fig. 
24C. After all of the horizontal and vertical vectors of 
the rough outline vector and their connection relation- 
ship have been extracted, a vector table as shown in 
25 Fig. 9 is made on the basis of the aforesaid vector ta- 
bles. 

Fig. 21 illustrates an example of an input image, 
and Fig. 22 illustrates the vector table obtained from 
the input image. 

30 

<Smoot hing/Coordinate-Conversion Circuit> 

The smoothing/coordinate-conversion circuit 109 
according to this embodiment will now be described. 

35 As shown in Fig. 10, the smoothing/coordinate-con- 
version circuit 109 according to this embodiment 
comprises a first smoothing circuit 191, a first 
smoothing conversion table 194, a second smoothing 
circuit 192 and a coordinate conversion circuit 193. 

40 The first smoothing circuit 191 receives the 

rough outline data strings, as shown in Fig. 9, convert- 
ed from the raster scanning type binary image by the 
outline extracting circuit 107 so as to convert the out- 
line coordinate data strings and to label the corner 

45 point in accordance with the state of the connection 
of the vectors while referring to the first smoothing 
and conversion table 194 in such a manner that the 
coordinate strings are traced for each closed vector 
region, so that information about apex coordinate 

so data strings and information showing whether or not 
each apex is a corner point after the first smoothing 
operation has been performed are outputted. In the 
second smoothing circuit 192, the weighted mean of 
the coordinate values of a plurality of points in front 

55 and in the rear of the subject point is obtained on the 
basis of the information about the first-smoothed 
apex coordinate data strings and information about 
the corner point so as to output the outline vector co- 

10 
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ordinate data strings. In the coordinate conversion cir- 
cuit 193, the coordinate values of the x-axis and y- 
axis are transposed and each coordinate value is mul- 
tiplied by the ratio of expansion/compression. If a con- 
traction process is performed, the smoothing process 
to be performed by the first smoothing circuits 191 
and 192 are bypassed and data is directly supplied to 
the coordinate conversion circuit 193. 

The aforesaid process will now be described. In 
the first smoothing circuit 191, references are made 
to the patterns of 7 vectors including at most three 
sides in front and in the rear of the subject pixel as 
shown in Figs. 11 to 18 so as to make a reference to 
the pattern of the direction and the length of each 
side, so that the rough outline coordinate value data 
strings are removed and/or converted. "N_pnt tt shown 
in Fig. 11 and so forth is the total number of closed 
loops of rough outline coordinate value data, a single 
circle denotes the starting point of the horizontal vec- 
tor and the end point of the vertical vector, a triangle 
denotes the end point of the horizontal vector and the 
starting point of the vertical vector, and a double circle 
denotes the corner point. The first smoothing opera- 
tion includes, as the subject, a pattern shown in Fig. 
11 and arranged to remove noise (notch/isolated 
point) peculiar to the binary image. That is, in an iso- 
lated pixel removal of one pixel size, all of the coor- 
dinate values of the pixel are deleted as shown in Fig. 
11. As a result, the problem that the pixel is undesir- 
ably highlighted at the time of enlarging the image can 
be prevented. If the white region present in a black re- 
gion is maintained, all of the outline coordinate are 
given corner point label at the time of outputting while 
maintaining the coordinate value. The term "corner 
point" used hereinbefore is meant a portion, the co- 
ordinate position is not moved even it has been sub- 
jected to the second smoothing process to be Descri- 
bed later. Although the description order is inverted, 
the left and upward directions are respectively made 
to be minus directions in this embodiment because 
the directions X and Y are made to be right and down- 
ward directions. Furthermore, a fact that -3" 
shows that at least three pixels are continued in the 
minus direction. 

Figs. 11 and 12 illustrate the aforesaid facts, and 
then the description will be continued with reference 
toon and after Fig. 13. 

Figs. 13A and 13B illustrate an arrangement 
made that the coordinate position showing an end 
portion of a thin line having a length corresponding at 
least three pixels is defined to be a corner point and 
change of its coordinate position is inhibited in the 
second smoothing process to be described later. In 
other words, rounding of the corner point is inhibited. 
It will be further described so as to be easily under- 
stood, a line segment having a width of one pixel and 
a length of 3 pixels or more and present in the back- 
ground is recognized to be a portion of a character or 



a line picture or the like in place of being recognized 
to be so-called "dust* contained in the read image. Al- 
though the length is arranged to be three pixels or 
more in this embodiment, it may be a length of two 

5 pixels if the reading resolution is unsatisfactory be- 
cause the length must be determined depending 
upon the reading resolution. If the image is read with 
a further excellent resolution, the length may be four 
or more pixels. The aforesaid fact is also applied to 

w the descriptions to be made hereinafter. 

Figs. 14Aand 14B illustrate an operation in which 
projections and pits of a size corresponding to one 
pixel in a flat state for a predetermined length (three 
pixels in this embodiment) are deleted, that is rough 

15 outline vector data of the projections and pits are de- 
leted. Fig. 15 illustrates an operation in which, if pro- 
jections and pits are continuously present, the projec- 
tions and pits are flattened. 

Figs. 16A to 16C illustrate the definition of the 

20 corner point and a concept of smoot hing of t he vector. 
Referring to Figs. 16A to 16C, symbol "D" denotes 
the subject rough outline vector. In the case of Fig. 
16A for example, the end point of the subject rough 
outline vector is made to be the corner point if the end 

25 point of the subject rough outline vector is positioned 
as illustrated. Furthermore, vector j present imme- 
diately in front of the subject vector D| is deleted, and 
the length, which is the same as vector D^ 2 posi- 
tioned secondarily in the forward direction is started 

30 from the starting point of the subject vector, and vec- 
tor which connects the end position and the starting 
position of the vector D^ 2 is updated as vector D^. 
In addition, a vector expressed by the end point of the 
updated vector D k2 and the corner point is updated 

35 as the subject vector. 

Figs. 1 7A and 1 7B illustrate a process of smooth- 
ing a moderate diagonal line portion. An edge inclined 
in a predetermined direction in such a way, for exam- 
ple, that it rises by one pixel and extends in the hori- 

40 zontal direction by 3 pixels or more, and then it again 
rises by one pixel as shown in Fig. 17A is made in 
such a manner that the middle point of the subject 
vector is made to be the end point of the immediately 
front vector D M and the starting point of the imme- 

45 diately rear vector D k1 . If the edge is inclined upwards 
and then it is inclined downwards at an intermediate 
position thereof, the aforesaid process is not per- 
formed. It can be discriminated by multiplying the in- 
clination of the immediately front vector and that of 

so the immediately rear vector so as to examine the sign. 
Fig. 17B illustrates an example in which five vectors 
are finally made to be three vectors. That is, in the 
conditions as illustrated, the immediately front and 
rear vectors of the subject vector D, are deleted, and 

55 a vector which connects the starting position of vector 
D(. 2 , which has not been smoothed yet, and point A 
on the subject vector Oi is made to be vector D^, a 
vector expressed by points A and B is made to be the 

11 
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subject vector D if and a vector expressed by the point 
A and the end point of the vector D,^ which has not 
been smoothed yet, is made to be vector D K2 . In the 
case shown in Figs. 18Ato 18C, processes as illu- 
strated are performed. In an example shown in Fig. 
18A, the intermediate position of the subject vector D| 
is made to be the end point of the immediately front 
vector and the starting point of the immediately rear 
vector. 

As the result of the aforesaid process performed 
by the first smoothing circuit 191, the rough outline 
vector constituted by only the vertical and horizontal 
vectors is allowed to have a diagonal vector. 

In the second smoothing circuit 192, the corner 
points marked by double circles shown in Fig. 19 are 
maintained, and the mean weight of the coordinate 
values (the coordinate values of the front and rear 
points in this embodiment) of a plurality of front and 
rear points positioned across the subject point of each 
coordinate point other than the corner point is ob- 
tained, and the each mean average is outputted as 
apex coordinate data strings, which has been subject- 
ed to the second smoothing process. Point Qi shown 
in Fig. 19 denotes the apex coordinate data strings, 
which has been subjected to the second smoothing 
process, and point Pi denotes an apex coordinate 
data, which has been subjected to the first smoothing 
process. In the illustrated example, Q1 is obtained 
from the mean average of P 0 (1, 3), (2, 2) and P 2 
(4, 1 ). The effective number of digits for use in the first 
and the second smoothing processes is arbitrarily de- 
termined so far as it is in a range which is effective to 
the recording resolution. 

In the coordinate conversion circuit 193, the co- 
ordinate transposition of the x-axis for y-axis required 
due to the main scanning of the processed image and 
that of the recorded image is performed, and a mul- 
tiplication of each coordinate string by the ratio of ex- 
pansion/compression is performed so as to be adapt- 
able to the expansion/compression process. 

In an example case where the supplied image is 
doubled in both of the main scanning and the sub- 
scanning directions, the coordinate conversion is per- 
formed in such a way that the x- and y-coordinates of 
each apex coordinate data string, which has been 
subjected to the second smoothing process, are dou- 
bled, and the fractions of 0.5 and over are counted as 
a unit and the rest is cut. 

As described above, the outline coordinate data 
strings obtained by the circuits 191 and 194 are out- 
putted to the memory B1 1 1 . Thus, the process is com- 
pleted. 

<Binary Image Reproducing Circuit and 
Intermediate Chrcuit> 

In the first embodiment, a page memory is used 
in which a bit map image memory is used by a quan- 



tity for one frame. The method of converting the out- 
line coordinate data strings into the binary raster im- 
age can be completely effectively employed. 

In the binary image reproducing circuit 110, an 

5 outline coordinate data strings stored in the memory 
B1 1 1 shown in Fig. 1 are read, and outlines for one im- 
age frame are drawn on the bit map image memory 
of the memory A1 03. 

Since the drawing operation can be performed at 

w high speed by the ensuing inside drawing circuit, and 
the outlines are drawn by the bit map image for one 
page, two or three line segment vectors (vectors con- 
necting each coordinate of the outline coordinate 
strings) positioned continuously are paid attention, 

is and references are made to the states (directions) of 
the subject line segment vector, a vector immediately 
in front of the subject line segment vector, and a vec- 
tor immediately in the rear of the subject line segment 
vector so as to control the method of drawing the out- 

20 line pixels present on the subject line segment vector. 
The contents of the control are as follows: an end 
point on the subject line segment vector, and points 
on the outline vector other than the end point are in- 
dividually treated, and a selection is made from a 

25 group consisting of an operation in which they are not 
drawn, an operation in which they are drawn at the 
pixel position on the line segment vector, and an op- 
eration in which they are drawn while being shifted in 
the main scanning direction on the line segment vec- 

30 tor to a position shifted to the adjacent pixel. The ac- 
tual operation of drawing the outline pixel is per- 
formed in such a way that the obtained exclusive OR 
(EXOR) of a stored value and 1 is stored at the pixel 
position to be drawn. In either case, the pixels are se- 

35 quentialiy read in the main scanning direction, so that 
the outline is so drawn as to enable the pixels to be 
switched. 

In the inside drawing circuit 104, the inside draw- 
ing process is performed by a pipe line process while 

40 reading the image having the drawn outlines because 
it has been subjected to the process of drawing all of 
the outline edges in a predetermined outline drawing 
circuit and stored in the bit map image memory (mem- 
ory A1 03) by raster scanning at an arbitrary synchron- 

45 izing timing. Then, it is again transferred to the bit map 
image. The inside drawing process is performed by a 
circuit shown in Fig. 20 in such a way that DATA re- 
ceived in synchronization with a signal CLK is output- 
ted to an terminal OUT in a state where the outline- 

50 drawn pixels are sequentially inverted between white 
and black. Symbols LSYNC is a line synchronizing 
signal which is supplied as a synchronization reset 
signal at the time of starting the input of the raster im- 
age. Reference numeral 195 denotes a latch which 

55 holds the value of output OUT of a pixel positioned 
forwards by one pixel. Reference numeral 196 de- 
notes an EXOR which outputs the EXOR of supplied 
data and the value of output OUT of the pixel posi- 
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tioned forwards by one pixel. That is, the output OUT 
becomes T or "0" whenever the outline points are 
supplied as DATA. 

Although the character/line image and the half 
tone image are, in this embodiment, separated from 5 
each other by the image region separation circuit, the 
region table for separating the image region can be 
omitted from the structure if the attribute of the image 
can be previously known by a mode selection button , 
of the image scanner or a communication protocol, 10 
and the switching whether or not the pixel density 
conversion by extracting the outline on the basis of 
the attribute of the image may be performed. In ad- 
dition, it is not always necessary in this embodiment 
for a circuit exclusively used to divide the original im- 15 
age into the character/line region (the binary image 
region) and the halftone image region to be provided. 
Since a pseudo halftone image has much outline co- 
ordinate data strings in one closed loop thereof as 
compared with a character/line image and the direc- 20 
tion of the vector frequently changes in one closed 
loop, another arrangement may be employed in 
which switching is, at the moment the smoothing 
process is performed, is performed whether or not 
the smoothing process is performed on the basis of 25 
the total number of the outline coordinate data strings 
in one closed loop in place of the image region sepa- 
ration circuit 200 and the region discrimination table, 
resulting in that the image region separation function 
can easily be realized. It can be processed specif ical- 30 
ly as follows. 

That is, since the minimum and maximum points 
of the x- and y-coordinate points of all of the vectors 
forming one closed loop can be obtained, the size of 
a rectangular circumscribed with the aforesaid closed 35 
loop can be determined. Namely, the size of the 
closed loop can indirectly taken out as the size of the 
rectangular. Hence, in accordance with the relation- 
ship between the size of the rectangular and the total 
number which forms the closed loop, a discrimination 40 
can be made as to whether or not smoothing is per- 
formed, that is, whether the closed loop is the half 
tone image or the character/line image. It should be 
noted that the relationship between the size of the 
rectangular and the dosed loop may be stored while 45 
being formed into a table or a formula. 

Consequently, it is possible to determine, on the 
basis of the vector obtained in series of processes of 
extracting an edge vector of an image, whether the 
original image is a halftone image or a binary image. so 

In this embodiment, both of the enlarge- 
ment/contraction (expansion/compression) process 
and the coding process to be performed by utilizing 
the outline coordinate data strings and the enlarge- 
ment/contract process by using the binary raster inv 55 
age are performed. Therefore, the data size of the 
outline coordinate data strings and the data size of 
the MH, MR or MMR coded data can be subjected to 



a comparison, so that image data, the quantity of 
which is smaller, is transmitted, resulting in that the 
communication time to be efficiently shortened. 

Since the quantity of the outline coordinate data 
strings becomes enlarged considerably depending 
upon the image, there is, depending upon the image, 
a risk of overflow of the memory at t he time of extract- 
ing the outline coordinate data strings. In this case, 
the outline extraction process may be interrupted and 
switching to the coordinate conversion (expan- 
sion/compression) process by using the binary raster 
image may be performed. That is, the final address 
position of the rough outline vector table, which is be- 
ing constituted, and the final effective address posi- 
tion of the memory are subjected to a comparison be- 
cause the capacity of the memory B111 is previously 
known. 

As for the expansion/compression by converting 
the coordinate as described above, different ratio of 
expansion/compressio can, of course, be multiplied to 
the main scanning and the sub-scanning, and there- 
fore, it can be performed for the x-axis and the y-axis 
individually. The aforesaid process is performed in 
such a way that the size of the received original im- 
age and the size of the paper sheet for use in printing 
out are subjected to a comparison, and the ratio of ex- 
pansion/compression of the x-axis and that of the y- 
axis are calculated. The ratio of expansion/compres- 
sion may be arbitrarily selected in accordance of the 
will of a user (operator). Furthermore, the ratio of ex- 
pansion/compression of the x- and the y-axes may be 
processed by the transmission side as a result of ne- 
gotiation, or it may be processed by the receiving side 
at the time of printing received data. 

Although black isolated points and notches are, 
in order to remove dust pixels, removed in the 
smoothing process according to the first embodi- 
ment, the notch and the isolated pixel removal pat- 
terns may be separated from the smoothing pattern 
by using an external switch mode (for example, by a 
switch provided on an operation panel which is omit- 
ted from illustration) because the notches and the iso- 
lated points of image data read with the standard re- 
solution conformed to G3 are required as information 
to read the character in many cases. By using an ex- 
ternal mode key, switching whether or not the 
smoothing process is performed can, of course, be 
performed. 

The coordinate conversion circuit 109 according 
to the first embodiment performs only the transposi- 
tion of the x- for the y-coordinates and the multiplica- 
tion by a ratio of expansion/compression. The read 
original document positions undesirably diagonally 
can be corrected by performing, at the aforesaid 
processes, the coordinate rotation by an affin trans- 
formation of the outline coordinate data strings on the 
basis of the output value from an apparatus (omitted 
from illustration) for detecting the diagonal angle of a 
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read original document. In this case, the edge posi- 
tions of the original document in the main scanning di- 
rection are sequentially detected if the original docu- 
ment is conveyed in the sub-scanning direction or if 
the scanner is moved in the sub-scanning direction to 
read the original document as shown in Fig. 25. That 
is, since the deviation quantity fx taken place when 
one original document sheet has been read and the 
conveyance quantity f y taken place at this time in the 
sub-scanning direction are detected, the diagonal an- 
gle 9 of the original document can be obtained by 
tan-Vy/fx). 
A variety of means can be considered to detect 
the change of the edge position of the original docu- 
ment. In an example case in which the recording side 
of the original document is read while conveying the 
original document, the color of the background (the 
color to be detected if no read original.document is 
present) at the reading position is made to be a color 
other than white. Since the background color of the 
original document is usually white, the edge can be 
detected by only making distinction from the white col- 
or of the background. As an alternative to this, the de- 
gree of the diagonal state may be detected by provid- 
ing a pressing plate, which presses the original docu- 
ment sheet by small force which is applied thereto in 
a lateral direction in the original document convey- 
ance direction and which is so determined as not to 
fold the original document sheet, and which is able to 
move in the horizontal direction (main scanning) di- 
rection, so as to detect the lateral movement quantity 
of the pressing plate with respect to the quantity of 
the conveyance of the original document 

The aforesaid diagonal state modification proc- 
ess may be arranged in such a way that the image of 
a read original document is reversely rotated (aff in- 
transformed) by the obtained diagonal angle after the 
read image has been stored in the memory A103 or 
at the time of storing it Then, the aforesaid process 
may be performed. As an alternative to this, coordin- 
ate data obtained by the aforesaid second smoothing 
process may be subjected to the rotation process. Al- 
though the aforesaid process may be automatically 
performed in the case where the diagonal state is 
modified, this fact may be notified to the operator (by, 
for example, a display made in a display portion pro- 
vided for the operation panel) and the operator may 
instruct whether or not the modification of the diago- 
nal state is performed. 

Another structure may be employed in which an 
arbitrary angle is instructed by using the operation 
panel to rotate the image, regardless of reading of the 
diagonal state of the original document That is, a 
countermeasure against occurrence that the charac- 
ters of the original document to be read is previously 
diagonally placed. 

Although the binary image reproducing circuit 
1 1 0 is arranged to use a page memory which uses the 
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image memory of the bit map for one picture frame, 
a scan line conversion (a packet sort method) may be 
employed which uses an edge table and an active 
edge table and which draws the ridge edge of the out- 
5 line image by a line buffer for several lines. 

Although this embodiment uses the printer as the 
image output apparatus, an image can be outputted 
onto a display by using a Video memory and a display 
in place of the FIFO 105 and the printer 106 shown 

10 in Fig. 1. 

Furthermore, an example of the application of 
communication which use the outline coordinate data 
strings may be employed which is arranged in such a 
way that a digitizer, which shows the image position, 

15 is individually provided and a decoration code 
(change of net decoration or inside drawing pattern, 
or change of the color) is additionally transferred to 
the closed loop of the outline coordinate data in re- 
gion instructed by the digitizer. As a result, the receiv- 

20 ing side is easily executing the change of the net dec- 
oration pattern or the inside drawing pattern or the 
change of the color in accordance with the decoration 
code. 

As an alternative to the arrangement in which 
25 font is developed into a binary raster image as is done 
in the case of the report or the header before trans- 
mission, it can be directly transmitted/received as font 
data using an outline, or the development of the con- 
ventional outline is commonly used by the binary im- 
30 age reproducing and the inside drawing circuits, so 
that the output of the outline font can easily be per- 
formed. 

The operations employed in the conventional re- 
solution conversion can, of course, be realized in this 

35 embodiment, and therefore, the arbitrary expan- 
sion/compression process, in which a ratio of expan- 
sion/compression instruction key is used, and a proc- 
ess for causing an elongated original document to be 
included by a regular-size cut paper by detecting the 

40 cassette size can be realized in the structure accord- 
ing to this embodiment. 

As described above, according to this embodi- 
ment, even if the original document is undesirably di- 
agonally read, the degree of the diagonal state is cor- 

45 rected by the reverse rotation, resulting in an excel- 
lent image, which is normally placed, can be ob- 
tained. 

Since the outline vector is extracted and the proc- 
ess is performed on the basis of the extracted outline 
so vector as well as treating the bit image of the original 
image, the generation of rough edges can be prevent- 
ed. 

Furthermore, the arrangement in which data ob- 
tained on the basis of the extracted outline vector is 
55 transmitted to the other end of the data line, and the 
receiving side reproduces and outputs an image on 
the basis of the received data will enable the time re- 
quired to perform the communication to be shortened 
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and enable transmission of precise image to be per- 
formed. 

In addition, since the outline vector extracted 
from the original image is smoothed and therefore the 
vector is enlarged to reproduce the image, a high 5 
grade image can be obtained regardless of the ratio 
of expansion/compression. 

Since the process of expansion/compression of 
the extracted outline vector is performed only when 
the resolution conversion is required, the load acting 10 
on the system can be minimized. Therefore, the re- 
duction in the processing speed at an ordinary proc- 
ess can be prevented. 

When the outline vector is extracted from the 
read binary image, a discrimination is made as to is 
whether or not the storage size of the outline vector 
is larger than the memory capacity. If a discrimination 
is made that the memory over takes place, the proc- 
ess of extracting the outline vector is immediately in- 
terrupted and switching to the process by using the 20 
binary image is performed. As a result, printing or 
transmission can be correctly performed even if the 
problem of memory over takes place. 

In the case where the expansion/compression 
process is performed on the basis of outline vector 25 
data, whether or not the smoothing process is per- 
formed in switched by using an external switch. As a 
result, whether the smoothing process is performed 
or a high processing speed is realized can be selected 
by the operator. Furthermore, the smoothing process 30 
is performed when the expansion/compression proc- 
ess of the read or received image is performed, an im- 
age revealing high quality and freed from distortion 
can be obtained. Furthermore, if an arrangement is 
employed in which the ratio of expansion/compres- 35 
sion is instructed by a switch (omitted from illustra- 
tion), an image having a desired size can be obtained. 
In addition, the expansion/compression process is 
performed on the basis of the outline vector size at 
only the time of performing the enlargement process. 40 
Therefore, the load acting on the apparatus can be 
lightened, and, hence, the undesirable reduction of 
the processing speed can be prevented at the time of 
the equal-magnification process or the size contrac- 
tion process. 45 

The expansion/compression process by using 
the outline vector is effective to only the character/li- 
ne image, but the obtainable result is unsatisfactory 
if the half tone image is subjected to the aforesaid 
process. However, the aforesaid embodiment is ar- so 
ranged in such a way that only the character/line im- 
age is subjected to the expansion/compression proc- 
ess which uses the outline vector data, and expan- 
sion/compression of the halftone image is varied by 
an interpolation of the pixel forming the image or by 55 
thinning the same. Hence, an excellent image can be 
obtained. 

In the communication performed between the 



apparatuses according to the embodiment, data to be 
transmitted may be outline coordinate data, and the 
transmission side or the receiving side is able to indi- 
vidually expand/compress data in the x- and y-direc- 
tions. Therefore, an excellent and desired image can 
be obtained even if the expansion/compression is 
performed. 

As described above, according to the first em- 
bodiment, the resolution conversion is performed 
only when the resolution conversion must be per- 
formed, and the deterioration of the image taken 
place due to the resolution conversion can be sub- 
stantially prevented. Therefore, the load acting on the 
apparatus can be lightened and a high quality image 
can be transmitted. 

Furthermore, the outline vector is extracted only 
when the resolution must be converted before it is 
smoothed to generate an image, resulting in an effect 
to be obtained in that a high quality image can be 
transferred. 

The present invention may be applied to a system 
constituted by a plurality of apparatuses, or to a sim- 
ple system having one apparatus. The present inven- 
tion may, of course, be applied to the case where a 
program is supplied to a system or an apparatus. 

<Second embodiment 

A second embodiment of the present invention 
will now be described. 

In the first embodiment, the switch for selecting 
whether the smoothing process is performed may or 
may not be provided. 

However, if the switch is turned on and the notch 
removal process is thereby performed in all cases 
without the type of an original or the resolution of a 
read image taken into consideration, a halftone image 
may be adversely affected. Also, there is the possi- 
bility that the isolated points in an image read at a low 
resolution, which should not be removed, are re- 
moved. Furthermore, even where the user desires to 
faithfully reproduce the original image, the notch re- 
moval process is performed regardless of the inten- 
tion of the user. 

Hence, a second embodiment of the present in- 
vention solves the above-described problems. 

A preferred second embodiment of the present 
invention will be described below with reference to 
the accompanying drawings. 

Fig. 26 is a block diagram of a second embodi- 
ment of an image processing apparatus of reading an 
image original, extracting an outline vector and out- 
putting an image. In Fig. 26, reference numeral 501 
denotes a CPU for performing control of an entire ap- 
paratus; 502 denotes a ROM for storing a control pro- 
gram executed by the CPU 501; 503 denotes a RAM 
used as the working region required to execute the 
control program; 504 denotes a scanner portion 
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(SCN) of reading an image original and generating bi- 
nary image data; 505 denotes an outline extracting 
circuit for extracting an outline vector of the binary im- 
age data; 507 denotes an image memory for storing 
the outline vector and data obtained by smoothing 
which will be described later, 508 denotes a smooth- 
ing circuit of performing smoothing/pixel density con- 
version on an image by operating the outline data 
stored in the image memory 507 and for generating 
smoothed data; 510 denotes a binary image generat- 
ing circuit for generating binary image data from the 
outline data (or from the smoothed data); 51 3 denotes 
a printer for outputting an reproduced binary image 
from the binary image data; 515 denotes a notch 
processing circuit for performing a notch process by 
extracting a vector row which is determined as a notch 
from the outline vector stored in the image memory 
507 and for outputting the outline vector to the image 
memory 507 again; 516 denotes a notch process set- 
ting switch (NSW) operated by the operator to instruct 
execution of the notch process to the CPU 501; 517 
denotes is a reading resolution setting switch (RSW) 
used by the operator to instruct the resolution at 
which an original is read to the CPU 501; and 514 de- 
notes a CPU bus for connecting the above compo- 
nents with each other. 

The smoothing circuit 508 in the second embodi- 
ment performs substantially the same process as 
that conducted by the smoothing/coordinate transfor- 
mation circuit 109 in the first embodiment, detailed 
description thereof being omitted. The difference be- 
tween the smoothing circuit 508 and the smooth- 
ing/coordinate transformation circuit 109 is that the 
smoothing circuit 508 does not perform the process- 
es shown inFigs.11,14Aand 14B, becausethese pix- 
el states are the objects of the process performed on 
the basis of an instruction given by a notch removal 
setting switch NSW 516. 

Next, the image reading/reproducing process 
executed by the image processing apparatus ar- 
ranged in the manner described above will be descri- 
bed below with reference to Fig. 27. 

First, in step S601, the operator places an image 
original on the scanner portion (SCN) 504, sets the 
notch process setting switch (NSW) 516 and the read- 
ing resolution setting switch (RSW) 517, and depress- 
es a starting key (not shown) of the apparatus. In step 
S601, the CPU 501 gives an instruction to the scan- 
ner portion (SCN) 504 according to the resolution set 
by the operator to initiate reading of an image original. 
Subsequently, in step S603, the CPU 501 stores bi- 
nary image data of one line read and generated by t he 
scanner portion (SCN) 504 in the image memory 507, 
and then in step S604, the CPU 501 conveys the im- 
age original in the vertical direction by a predeter- 
mined amount of feed corresponding to the resolution 
set by the resolution setting switch 517. In step S605, 
it is determined whether the final end of the image 



original is detected. If the final end of the image orig- 
inal to be read is not reached, the process returns to 
step S603, and an image of a subsequent line is read. 
If the final end of the image original is detected, read- 
5 ing of the image original of one page is completed, 
and the process goes to step S606. 

In step S606, the CPU 501 supplies the read bi- 
nary image data to the outline extraction circuit 505 
and initiates the outline extraction process when a 
10 processable number of lines of the binary image data 
has been input In the outline extraction process, the 
binary image data is converted into an outline vector 
row (corresponding to the rough contour vector data 
in the first embodiment). The results of the outline ex- 
15 traction process are output to the image memory 507 
again. In step S607, the CPU 501 inputs the outline 
data stored in the image memory 507 to the smooth- 
ing circuit 508, and executes the smoothing process. 
The results of the smoothing process are output to 
20 the image memory 507 in the form of an outline vec- 
tor row again. As stated above, the smoothing circuit 
508 does not perform the notch removal process 
shown in Figs. 11, 14Aand 14B. 

In step S608, the CPU 501 reads the set state of 
25 the notch process setting switch (NSW) 516 and the 
set state of the reading resolution setting switch 
(RSW) 517, and determines whether the set state of 
the notch process setting switch (NSW) 516 is a notch 
process instructing state and the set state of the read- 
30 ing resolution setting switch (RSW) 517 is a high re- 
solution reading instructing state. If the answer is af- 
firmative, the process goes to step S609, and the out- 
line vector row is input to the notch processing block 
51 5 to execute the notch removal process, that is, the 
35 process shown in Figs. 11 , 14Aand 14B is performed. 
The results of the notch removal process are output 
to the image memory 507 in the form of an outline 
vector row. If it is determined that the notch removal 
process has not been instructed or the instructed 
40 reading resolution is low, the process goes to step 
S610. 

In step S610, the CPU 501 inputs the outline vec- 
tor row stored in the image memory 507 into the bi- 
nary image generating circuit 510, generates binary 

45 image data, and outputs it to the printer 513. Finally, 
in step S61 1 , t he printer 51 3 outputs a reproduced im- 
age of one page on the basis of the binary image 
data. In other words, the notch removal process is 
performed only when the original is read at a high re- 

50 solution. 

Thus, since the notch process setting switch 
(NSW) 516 and the reading resolution setting switch 
(RSW) 517 are provided in the second embodiment, 
it is possible to perform the notch-removal process 

55 according to the instruction given by the operator or 
the image reading resolution. 

In the second embodiment, a reproduced image 
is output from the printer. However, the present inven- 
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tion is not limited to this, and the reproduced image 
may be output to another recording media (such as a 
semiconductor memory or a magnetic disk). Further- 
more, in the second embodiment, the image reading 
resolution has been described as high and low reso- 
lutions. This may sound that the number of selectable 
resolutions is two. However, the present invention is 
not limited to this and the number of resolutions se- 
lectable by the reading resolution setting switch 
(RSW) may be set to N, and the low resolution may 
be defined as lower M resolutions in the N resolu- 
tions. In the above-described first and second em- 
bodiments, an isolated single pixel or a protruding or 
recessed single pixel has been described as a notch. 
However, this may depend on the resolution. More 
specifically, in the case of a high resolution, at least 
two consecutive pixels may be described as a notch. 

The present invention can be applied to a system 
made up of a plurality of devices or an apparatus 
made up of a single device. The present invention can 
also be applied to a system or a case in which a pro- 
gram is supplied to the apparatus. 

In the second embodiment, since the notch re- 
moval process is performed according to the desig- 
nated image original reading resolution and/or the 
notch removal instruction, execution of the notch re- 
moval process is made selectable, and notch removal 
can thus be performed according to the intention of 
the operator or the type of the image original. Con- 
sequently, generation of deterioration in the image 
quality due to the uniform notch removal process can 
be restricted. 

In the second embodiment, when an original is 
read at a high resolution and when the notch removal 
process is instructed, a notch is removed. That is, 
there are two conditions under which notch removal 
is performed in the second embodiment Another 
condition, in which it is determined whether the orig- 
inal image is a binary image, such as a character or 
a line, or a halftone image, such as a photograph, may 
be added to the above two conditions. That is, if the 
original image is a binary image, such as a character 
or a line, if the original is read at a high resolution and 
if notch removal is instructed, notch removal may be 
performed in step S609. The third condition is added 
because when the original is binarized on the basis 
of the dither method or the error diffusion method, 
the generated isolated pixel is not a notch but a pixel 
representing the apparent density of that image: not 
a pixel generated by noise or like. The operator may 
designate whether the original image is a halftone im- 
age or a binary image by operating a separately pro- 
vided switch. Alternatively, as described in the first 
embodiment, the determination may be made on the 
basis of changes in the density of read image data 
(which is not yet binarized). In addition, where the 
original image has both a character region and a pho- 
tographic region, the latter region is the object of 



notch removal, as in the case of the first embodiment. 

The step S607 shown in Fig. 27 may be executed 
immediately before step S610. This allows a smooth- 
ing circuit 508 having exactly the same structure as 
5 that of the first embodiment to be employed. 

As many apparently widely different embodi- 
ments of the present invention can be made without 
departing from the spirit and scope thereof, it is to be 
understood that the invention is not limited tothespe- 
10 crfic embodiments thereof except as defined in the 
appended claims. 

Claims 

15 

1. An image processing apparatus comprising: 

separation means for separating an input 
image into a binary image region and a halftone 
image region; and 
20 contour extraction means for extracting 

contour vector data along an image edge in the 
binary image region separated by said separation 
means, 

whereby expansion or enlargement of an 
25 image in the binary image region in the input im- 

age is processed on the basis of the contour vec- 
tor data extracted by said contour extraction 
means. 

30 2. An image processing apparatus according to 
claim 1, further comprising smoothing means for 
separately correcting a predetermined number of 
consecutive vector data items in the contour vec- 
tor data extracted by said contour extraction 
35 means on the basis of the predetermined number 

of vector data items such that a locus expressed 
by the vector data items are smoothed, 

the expansion or compression process be- 
ing conducted on the vector data items corrected 
40 by said smoothing means. 

3. An image processing apparatus according to 
claim 2, wherein said smoothing means includes 
first smoothing means and second smoothing 
45 means, 

said first smoothing means including: 
discrimination means for discriminating a 
point position which is not an object of smoothing 
on the basis of the connection relation between 
so the predetermined number of consecutive vec- 
tors in the vector data extracted by said contour 
extraction means; 

deletion means for deleting the vector data 
which forms a closed-loop extracted by said con- 
55 tour extraction means when the vector data has 
a size smaller than or equal to a predetermined 
size; 

means for deleting the vector data which 
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forms an irregularity having a size smaller than 
or equal to a predetermined size when the irreg- 
ularity is present within a region having a prede- 
termined length in the extracted vector data and 
for connecting the vectors located in advance of 
and beyond the irregularity; and 

means for allowing for a slanting vector by 
deleting a plurality of vertical or horizontal vectors 
in the predetermined number of vectors on the 
basis of a length and a direction of each of the 
consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of the remaining vectors, 

said second smoothing means including: 
means for correcting the starting or end- 
ing point position of the single vector in the con- 
secutive vector data smoothed by said first 
smoothing means except for the point which is 
not determined as the object of smoothing by 
said discrimination means by calculating a weight 
means of the starting or ending point coordinates 
of the plurality of vectors located in advance of 
beyond the single vector. 

4. An image processing method comprising the 
steps of: 

separating an input image into a binary im- 
age region and a halftone image region; and 

extracting contour vector data along an 
edge of an image in the separated binary image 
region, 

whereby expansion or compression of an 
image in the binary image region in the input im- 
age is processed on t he basis of the contour vec- 
tor data extracted by said contour extraction step. 

5. An image processing method according to claim 

4, further comprising the step of: separately cor- 
recting a predetermined number of consecutive 
vector data items in the contour vector data ex- 
tracted by said contour extraction step on the ba- 
sis of the predetermined number of vector data 
items such that a locus expressed by the vector 
data items are smoothed, 

the compression or expansion process be- 
ing conducted on the vector data items corrected 
by said smoothing step. 

6. An image processing method according to claim 

5, wherein said smoothing step includes a first 
smoothing step and a second smoothing step, 

said first smoothing step including the 
steps of: 

discriminating a point position which is not 
an object of smoothing on the basis of the con- 
nection relation between the predetermined 
number of consecutive vectors in the vector data 
extracted by said contour extraction step; 



deleting the vector data which forms a 
closed-loop extracted by said contour extraction 
step when the vector data has a size smaller than 
or equal to a predetermined size; 

deleting the vector data which forms an ir- 
regularity having a size smaller than or equal to 
a predetermined size when the irregularity is 
present within a region having a predetermined 
length in the extracted vector data and for con- 
necting the vectors located in advance of and be- 
yond the irregularity; and 

allowing for a slanting vector by deleting a 
plurality of vertical or horizontal vectors in the 
predetermined number of vectors on the basis of 
a length and a direction of each of the consecu- 
tive predetermined number of vectors and by cor- 
recting a starting or ending coordinate position of 
each of the remaining vectors, 

said second smoothing step including the 
steps of. 

correcting the starting or ending point pos- 
ition of the single vector in the consecutive vector 
data smoothed by said first smoothing step ex- 
cept for the point which is not determined as the 
object of smoothing by said discrimination step 
by calculating a weighted means of the starting or 
ending point coordinates of the plurality of vec- 
tors located in advance of beyond the single vec- 
tor. 

7. An image processing apparatus in which image 
data is input and an image is reproduced by a pre- 
determined device, said apparatus comprising: 

contour extraction means for extracting 
contour coordinate data along an edge of the in- 
put image; 

smoothing means for smoothing the ex- 
tracted contour coordinate data; and 

reproduction means for reproducing the 
image on the basis of the contour coordinate data 
which has been smoothed by said smoothing 
means. 

8. An image processing apparatus according to 
claim 7, wherein said smoothing means includes 
first smoothing means and second smoothing 
means, 

said first smoothing means including: 
discrimination means for discriminating a 
point position which is not an object of smoothing 
on the basis of the connection relation between 
the predetermined number of consecutive vec- 
tors in the vector data extracted by said contour 
extraction means; 

deletion means for deleting the vector data 
which forms a closed-loop extracted by said con- 
tour extraction means when the vector data has 
a size smaller than or equal to a predetermined 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



18 



EP 0554S65A2_I_> 



35 



EP0 554 985 A2 



36 



size; 

connecting means for deleting the vector 
data which forms an irregularity having a size 
smaller than or equal to a predetermined size 
when the irregularity is present within a region 5 
having a predetermined length in the extracted 
vector data and for connecting the vectors locat- 
ed in advance of and beyond the irregularity; and 

means for allowing for a slanting vector by 
deleting a plurality of vertical or horizontal vectors 10 
in the predetermined number of vectors on the 
basis of a length and a direction of each of the 
consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of the remaining vectors, 1 5 

said second smoothing means including: 

means for correcting the starting or end- 
ing point position of the single vector in the con- 
secutive vector data smoothed by said first 
smoothing means except for the point which is 20 
not determined as the object of smoothing by 
said discrimination means by calculating a 
weighted means of the starting or ending point 
coordinates of the plurality of vectors located in 
advance of beyond the single vector. 25 

9. An image processing method in which image 
data is input and an image is reproduced by a pre- 
determined device, said method comprising the 
steps of: 30 

extracting contour coordinate data along 
an edge of the input image; 

smoothing the extracted contour coordin- 
ate data; and 

reproducing the image on the basis of the 35 
smoothed contour coordinate data. 

10. An image processing method according to claim 
9, wherein said smoothing step includes a first 
smoothing step and a second smoothing step, 40 

said first smoothing step including the 
steps of: 

discriminating a point position which is not 
an object of smoothing on the basis of the con- 
nection relation between the predetermined 45 
number of consecutive vectors in the vector data 
extracted by said contour extraction step; 

deleting the vector data which forms a 
closed-loop extracted by said contour extraction 
step when the vector data has a size smaller than so 
or equal to a predetermined size; 

deleting the vector data which forms an ir- 
regularity having a size smaller than or equal to 
a predetermined size when the irregularity is 
present within a region having a predetermined 55 
length in the extracted vector data and for con- 
necting the vectors located in advance of and be- 
yond the irregularity; and 



allowing for a slanting vector by deleting a 
plurality of vertical or horizontal vectors in the 
predetermined number of vectors on the basis of 
a length and a direction of each of the consecu- 
tive predetermined number of vectors and by cor- 
recting a starting or ending coordinate position of 
each of the remaining vectors, 

said second smoothing step including the 
steps of: 

correcting the starting or ending point pos- 
ition of the single vector in the consecutive vector 
data smoothed by said first smoothing step ex- 
cept for the point which is not determined as the 
object of smoothing by said discrimination step 
by calculating a weighted means of the starting or 
ending point coordinates of the plurality of vec- 
tors located in advance of beyond the single vec- 
tor. 

11. An image processing apparatus in which image 
data is input and an image is reproduced by a pre- 
determined device, said apparatus comprising: 

contour extraction means for extracting 
contour vector data along an edge of the input im- 
age; 

comparison means for comparing a reso- 
lution of the input image with a resolution of said 
reproducing device; 

smoothing means for smoothing the con- 
tour vector data extracted by said contour extrac- 
tion means on the basis of the results of the com- 
parison by said comparison means; and 

generation means for generating a record- 
ed image on the basis of the contour vector data 
which has been smoothed by said smoothing 
means. 

12. An image processing apparatus according to 
claim 11, wherein said smoothing means is 
turned on when said comparison means determi- 
nes that the resolution of the input image is lower 
than the resolution of said reproducing device. 

13. An image processing apparatus according to 
claim 11, wherein said smoothing means in- 
cludes first smoothing means and second 
smoothing means, 

said first smoothing means including: 
discrimination means for discriminating a 
point position which is not an object of smoothing 
on the basis of the connection relation between 
the predetermined number of consecutive vec- 
tors in the vector data extracted by said contour 
extraction means; 

deletion means for deleting the vector data 
which forms a closed-loop extracted by said con- 
tour extraction means when the vector data has 
a size smaller than or equal to a predetermined 
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size; 

connecting means for deleting the vector 
data which forms an irregularity having a size 
smaller than or equal to a predetermined size 
when the irregularity is present within a region 
having a predetermined length in the extracted 
vector data and for connecting the vectors locat- 
ed in advance of and beyond the irregularity; and 

means for allowing for a slanting vector by 
deleting a plurality of vertical or horizontal vectors 
in the predetermined number of vectors on the 
basis of a length and a direction of each of the 
consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of the remaining vectors, 

said second smoothing means including: 

means for correcting the starting or end- 
ing point position of the single vector in the con- 
secutive vector data smoothed by said first 
smoothing means except for the point which is 
not determined as the object of smoothing by 
said discrimination means by calculating a 
weighted means of the starting or ending point 
coordinates of the plurality of vectors located in 
advance of beyond the single vector. 

14. An image processing method in which image 
data is input and an image is reproduced by a pre- 
determined device, said method comprising the 
steps of: 

extracting contour vector data along an 
edge of the input image; 

comparing a resolution of the input image 
with a resolution of said reproducing device; 

smoot h ing the contour vector data extract- 
ed in said contour extraction step on the basis of 
the results of the comparison of said comparison 
step; and 

generating a recorded image on the basis 
of the contour vector data which has been 
smoothed by said smoothing step. 

15. An image processing method according to claim 
14, wherein said smoothing step is turned on 
when it is determined that the resolution of the in- 
put image is lower than the resolution of said re- 
producing device in said comparison step. 

16. An image processing method according to claim 
14, wherein said smoothing step includes a first 
smoothing step and a second smoothing step, 

said first smoothing step including the 
steps of: 

discriminating a point position which is not 
an object of smoothing on the basis of the con- 
nection relation between the predetermined 
number of consecutive vectors in the vector data 
extracted by said contour extraction step; 



deleting the vector data which forms a 
closed-loop extracted by said contour extraction 
step when the vector data has a size smallerthan 
or equal to a predetermined size; 

5 deleting the vector data which forms an ir- 

regularity having a size smaller than or equal to 
a predetermined size when the irregularity is 
present within a region having a predetermined 
length in the extracted vector data and for con- 

10 necting the vectors located in advance of and be- 
yond the irregularity; and 

allowing for a slanting vector by deleting a 
plurality of vertical or horizontal vectors in the 
predetermined number of vectors on the basis of 

15 a length and a direction of each of the consecu- 
tive predetermined number of vectors and by cor- 
recting a starting or ending coordinate position of 
each of the remaining vectors, 

said second smoothing step including the 

20 steps of: 

correcting the starting or ending point pos- 
ition of the single vector in the consecutive vector 
data smoothed by said first smoothing step ex- 
cept for the point which is not determined as the 

25 object of smoothing by said discrimination step 
by calculating a weighted means of the starting or 
ending point coordinates of the plurality of vec- 
tors located in advance of beyond the single vec- 
tor. 

30 

17. An image processing apparatus in which image 
data is input and output to a predetermined de- 
vice, said apparatus comprising: 

contour extraction means for extracting 
35 contour vector data along an edge of the input im- 

age; 

storage means for storing the extracted 
contour vector data; and 

image generation means for generating an 
40 image to be output to said predetermined device 

on the basis of the contour vector stored in said 
storage means, said apparatus further compris- 
ing: 

control means for controlling such that the 
45 input image is output to said predetermined de- 
vice when it determines during storage that the 
contour vector to be stored in said storage means 
exceeds a storage capacity of said storage 
means. 

50 

18. An image processing apparatus according to 
claim 17, wherein said predetermined device is a 
printer. 

55 19. An image processing apparatus according to 
claim 17, wherein said predetermined device is a 
facsimile machine connected to a communication 
line. 

20 
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20. An image processing apparatus according to 
claim 17, further comprising smoothing means 
for separately correcting a predetermined num- 
ber of consecutive vector data items in the con- 
tour vector data extracted by said contour extrac- 
tion means on the basis of the predetermined 
number of vector data items such that a locus ex- 
pressed by the vector data items are smoothed, 

the expansion or compression process be- 
ing conducted on the vector data items corrected 
by said smoothing means. 

21. An image processing apparatus according to 
claim 18, wherein said smoothing means in- 
cludes first smoothing means and second 
smoothing means, 

said first smoothing means including: 
discrimination means for discriminating a 
point position which is not an object of smoothing 
on the basis of the connection relation between 
the predetermined number of consecutive vec- 
tors in the vector data extracted by said contour 
extraction means; 

deletion means fordeleting the vector data 
which forms a closed-loop extracted by said con- 
tour extraction means when the vector data has 
a size smaller than or equal to a predetermined 
size; 

connecting means for deleting the vector 
data which forms an irregularity having a size 
smaller than or equal to a predetermined size 
when the irregularity is present within a region 
having a predetermined length in the extracted 
vector data and for connecting the vectors locat- 
ed in advance of and beyond the irregularity; and 

means for allowing for a slanting vector by 
deleting a plurality of vertical or horizontal vectors 
in the predetermined number of vectors on the 
basis of a length and a direction of each of the 
consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of the remaining vectors, 

said second smoothing means including: 

means for correcting the starting or end- 
ing point position of the single vector in the con- 
secutive vector data smoothed by said first 
smoothing means except for the point which is 
not determined as the object of smoothing by 
said discrimination means by calculating a 
weighted means of the starting or ending point 
coordinates of the plurality of vectors located in 
advance of beyond the single vector. 

22. An image processing method in which image 
data is input and output to a predetermined de- 
vice, said method comprising the steps of. 

extracting contour vector data along an 
edge of the input image; 



storing the extracted contour vector data 
in a predetermined memory; and 

generating an image to be output to said 
predetermined device on the basis of the contour 
5 vector stored in said memory, said method fur- 

ther comprising the step of: 

controlling such that the input image is 
output to said predetermined device when it is de- 
termined during storage that the contour vector 
10 to be stored in said memory exceeds a storage 
capacity of said memory. 

23. An image processing method according to claim 
22, wherein said predetermined device is a prin- 
ts ter. 

24. An image processing method according to claim 
22, wherein said predetermined device is a fac- 
simile machine connected to a communication 

20 line. 

25. An image processing method according to claim 
22, further comprising the step of separately cor- 
recting a predetermined number of consecutive 

25 vector data items in the contour vector data ex- 

tracted in said contour extraction step on the ba- 
sis of the predetermined number of vector data 
items such that a locus expressed by the vector 
data items are smoothed, 
30 said storage means storing the vector data 

items corrected in said smoothing step. 

26. An image processing method according to claim 
25, wherein said smoothing step includes a first 

35 smoothing step and a second smoothing step, 

said first smoothing step including the 
steps of: 

discriminating a point position which is not 
an object of smoothing on the basis of the con- 

40 nection relation between the predetermined 

number of consecutive vectors in the vector data 
extracted by said contour extraction step; 

deleting the vector data which forms a 
closed-loop extracted by said contour extraction 

45 step when the vector data has a size smaller than 

or equal to a predetermined size; 

deleting the vector data which forms an ir- 
regularity having a size smaller than or equal to 
a predetermined size when the irregularity is 

so present within a region having a predetermined 

length in the extracted vector data and for con- 
necting the vectors located in advance of and be- 
yond the irregularity; and 

allowing for a slanting vector by deleting a 

55 plurality of vertical or horizontal vectors in the 

predetermined number of vectors on the basis of 
a length and a direction of each of the consecu- 
tive predetermined number of vectors and by cor- 
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recting a starting or ending coordinate position of 
each of the remaining vectors, 

said second smoothing step including the 
steps of: 

correcting the starting or ending pointpos- 5 
ition of the single vector in the consecutive vector 
data smoothed by said first smoothing step ex- 
cept for the point which is not determined as the 
object of smoothing by said discrimination step 
by calculating a weighted means of the starting or 10 
ending point coordinates of the plurality of vec- 
tors located in advance of beyond the single vec- 
tor. 

27. An image processing apparatus comprising: 15 

contour extraction means for extracting 
contour vector data along an edge of an input im- 
age; 

counting means for counting a number of 
points representing vectors in each of contour 20 
closed-loops extracted by said contour extraction 
mean; 

detection means for detecting a size of 
each of the closed loops on the basis of the ex- 
tracted contour vector data; and 25 

discrimination means for discriminating 
whether an image region represented by each of 
the closed loops is a halftone image or a charac- 
ter/line image on the basis of the size of each of 
the closed loops detected by said detection 30 
means and the number of vector points corre- 
sponding to each of the closed loops. 

28. An image processing apparatus according to 
claim 27, further comprising smoothing means 35 
for separately correcting a predetermined num- 
ber of consecutive vector data items in the con- 
tour vector data extracted by said contour extrac- 
tion means on the basis of the predetermined 
number of vector data items such that a locus ex- 40 
pressed by the vector data items are smoothed, 

and 

output means for outputting an image to a 
predetermined device on the basis of the correct- 
ed vector data items. 45 

29. An image processing apparatus according to 
claim 28, wherein said predetermined device is a 
printer. 

so 

30. An image processing apparatus according to 
claim 28, wherein said predetermined device is a 
facsimile machine connected to a communication 
line. 

55 

31. An image processing apparatus according to 
claim 28, wherein said smoothing means in- 
cludes first smoothing means and second 



smoothing means, 

said first smoothing means including: 
discrimination means for discriminating a 
point position which is not an object of smoothing 
on the.basis of the connection relation between 
the predetermined number of consecutive vec- 
tors in the vector data extracted by said contour 
extraction means; 

deletion means for deleting the vector data 
which forms a closed-loop extracted by said con- 
tour extraction means when the vector data has 
a size smaller than or equal to a predetermined 
size; 

connecting means for deleting the vector 
data which forms an irregularity having a size 
smaller than or equal to a predetermined size 
when the irregularity is present within a region 
having a predetermined length in the extracted 
vector data and for connecting the vectors locat- 
ed in advance of and beyond the irregularity; and 

means for allowing for a slanting vector by 
deleting a plural ity of vertical or horizontal vectors 
in the predetermined number of vectors, on the 
basis of a length and a direction of each of the 
consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of the remaining vectors, 

said second smoothing means including: 

means for correcting the starting or end- 
ing point position of the single vector in the con- 
secutive vector data smoothed by said first 
smoothing means except for the point which is 
not determined as the object of smoothing by 
said discrimination means by calculating a 
weighted means of the starting or ending point 
coordinates of the plurality of vectors located in 
advance of beyond the single vector. 

32. An image processing method comprising the 
steps of: 

extracting contour vector data along an 
edge of an input image; 

counting a number of points representing 
vectors in each of extracted contour closed- 
loops; 

detecting a size of each of the closed loops 
on the basis of the extracted contour vector data; 
and 

discriminating whether an image region 
represented by each of the closed loops is a half- 
tone image or a character/line image on the basis 
of the size of each of the closed loops detected 
in said detection step and the number of vector 
points corresponding to each of the closed loops. 

33. An image processing method according to claim 
32, further comprising the step of separately cor- 
recting a predetermined number of consecutive 
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vector data items in the contour vector data ex- 
tracted in said contour extraction step on the ba- 
sis of the predetermined number of vector data 
items such that a locus expressed by the vector 
data items are smoothed, and 5 

outputting an image to a predetermined 
device on the basis of the corrected vector data. 

34. An image processing method according to claim 

33, wherein said predetermined device is a prin- 10 
ter. 

35. An image processing method according to claim 
33, wherein said predetermined device is a fac- 
simile machine connected to a communication 15 
line. 

36. An image processing method according to claim 
35, wherein said smoothing step includes a first 
smoothing step and a second smoothing step, 20 

said first smoothing step including the 
steps of: 

discriminating a point position which is not 
an object of smoothing on the basis of the con- 
nection relation between the predetermined 25 
number of consecutive vectors in the vector data 
extracted by said contour extraction step; 

deleting the vector data which forms a 
closed-loop extracted by said contour extraction 
step when the vector data has a size smaller than 30 
or equal to a predetermined size; 

deleting the vector data which forms an ir- 
regularity having a size smaller than or equal to 
a predetermined size when the irregularity is 
present within a region having a predetermined 35 
length in the extracted vector data and for con- 
necting the vectors located in advance of and be- 
yond the irregularity; and 

allowing for a slanting vector by deleting a 
plurality of vertical or horizontal vectors in the 40 
predetermined number of vectors on the basis of 
a length and a direction of each of the consecu- 
tive predetermined number of vectors and by cor- 
recting a starting or ending coordinate position of 
each of the remaining vectors, 45 

said second smoothing step including the 
steps of: 

correcting the starting or ending point pos- 
ition of the single vector in the consecutive vector 
data smoothed by said first smoothing step ex- so 
cept for the point which is not determined as the 
object of smoothing by said discrimination step 
by calculating a weighted means of the starting or 
ending point coordinates of the plurality of vec- 
tors located in advance of beyond the single vec- 55 
tor. 

37. An image processing apparatus comprising: 

23 



contour extraction means for extracting 
contour vector data along an edge of an input im- 
age; 

smoothing means for smoothing the ex- 
tracted contour vector data; and 

generation means for generating an output 
image according to the contour vector data which 
has been smoothed by said smoothing means, 
said apparatus further comprising: 

counting means for counting a number of 
points representing vectors in each of contour 
closed-loops extracted by said contour extraction 
mean; 

detection means for detecting a size of 
each of the closed loops on the basis of the ex- 
tracted contour vector data; and 

control means for controlling whether said 
smoothing means is turned on for each of the 
closed loops on the basis of the size of each of 
the closed loops detected by said detection 
means and the number of vector points corre- 
sponding to each of the closed loops. 

38. An image processing method comprising the 
steps of: 

extracting contour vector data along an 
edge of an input image; 

smoothing the extracted contour vector 
data; and 

generating an output image on the basis of 
the contour vector data which has been smooth- 
ed in said smoothing step, said method further 
comprising the steps of: 

counting a number of points representing 
vectors in each of contour closed-loops extracted 
in said contour extraction step; 

detecting a size of each of the closed loops 
on the basis of the extracted contour vector data; 
and 

. controlling whether said smoothing proc- 
ess is turned on for each of the closed loops on 
the basis of the size of each of the closed loops 
detected in said detection step and the number of 
vector points corresponding to each of the closed 
loops. 

39. An image processing apparatus in which an input 
image is enlarged or reduced and is then output, 
said apparatus comprising: 

contour extraction means for extracting 
contour vector data along an edge of the input im- 
age; 

smoothing means for smoothing the ex- 
tracted contour vector data; and 

expansion or compression means for ex- 
panding or compressing the contour vector data 
from said contour extraction means or said 
smoothing means separately for each of axes in 
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edge of the input image; 

smoothing the extracted contour vector 
data; and 

expansion or compression means for en- 
5 larging or reducing the contour vector data from 

said contour extraction step or said smoothing 
step separately for each of axes in an orthogonal 
coordinate system. 

10 43. An image processing method according to claim 



an orthogonal coordinate system. 

40. An image processing apparatus according to 
claim 39, further comprising detection means for 
detecting a degree of inclination of the input im- 
age; and 

image conversion means for correcting 
the input image or the vector data which has been 
smoothed by said smoothing means according to 
the detected degree of inclination and thereby 
converting the input image or the vector data into 
an erected image. 

41. An image processing apparatus according to 
claim 39, wherein said smoothing means in- is 
eludes first smoothing means and second 
smoothing means, 

said first smoothing means including: 
discrimination means for discriminating a 
point position which is not an object of smoothing 20 
on the basis of the connection relation between 
the predetermined number of consecutive vec- 
tors in the vector data extracted by said contour 
extraction means; 

deletion means for deleting the vector data 25 
which forms a closed-loop extracted by said con- 
tour extraction means when the vector data has 
a size smaller than or equal to a predetermined 
size; 

connecting means for deleting the vector 30 
data which forms an irregularity having a size 
smaller than or equal to a predetermined size 
when the irregularity is present within a region 
having a predetermined length in the extracted 
vector data and for connecting the vectors locat- 35 
ed in advance of and beyond the irregularity; and 

means for allowing for a slanting vector by 
deleting a plurality of vertical or horizontal vectors 
in the predetermined number of vectors on the 
basis of a length and a direction of each of the 40 
consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of the remaining vectors, 

said second smoothing means including: 

means for correcting the starting or end- 45 
ing point position of the single vector in the con- 
secutive vector data smoothed by said first 
smoothing means except for the point which is 
not determined as the object of smoothing by 
said discrimination means by calculating a so 
weighted means of the starting or ending point 
coordinates of the plurality of vectors located in 
advance of beyond the single vector. 

42. An image processing method in which an input 55 
image is enlarged or reduced and then output, 
said method comprising the steps of: 

extracting contour vector data along an 



42, further comprising the steps of detecting a 
degree of inclination of the input image; and 

correcting the input image or the vector 
data which has been smoothed in said smoothing 
step according to the detected degree of inclina- 
tion and thereby converting the input image or 
the vector data into an erected image. 

44. An image processing method according to claim 
42, wherein said smoothing step includes a first 
smoothing step and a second smoothing step, 

said first smoothing step including the 
steps of: 

discriminating a point position which is not 
an object of smoothing on the basis of the con- 
nection relation between the predetermined 
number of consecutive vectors in the vector data 
extracted by said contour extraction step; 

deleting the vector data which forms a 
closed-loop extracted by said contour extraction 
step when the vector data has a size smaller than 
or equal to a predetermined size; 

deleting the vector data which forms an ir- 
regularity having a size smaller than or equal to 
a predetermined size when the irregularity is 
present within a region having a predetermined 
length in the extracted vector data and for con- 
necting the vectors located in advance of and be- 
yond the irregularity; and 

allowing for a slanting vector by deleting a 
plurality of vertical or horizontal vectors in the 
predetermined number of vectors on the basis of 
a length and a direction of each of the consecu- 
tive predetermined number of vectors and by cor- 
recting a starting or ending coordinate position of 
each of the remaining vectors. 

said second smoothing step including the 
steps of. 

correcting the starting or ending point pos- 
ition of the single vector in the consecutive vector 
data smoothed by said first smoothing step ex- 
cept for the point which is not determined as the 
object of smoothing by said discrimination step 
by calculating a weighted means of the starting or 
ending point coordinates of the plurality of vec- 
tors located in advance of beyond the single vec- 
tor. 
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45. An image processing apparatus in which image 
data is input and output to a predetermined de- 
vice, said apparatus comprising: 

contour extraction means for extracting 
contour vector data along an edge of the input im- 
age; 

smoothing means for smoothing the con- 
tour vector data extracted by said contour extrac- 
tion means; 

determination means for determining 
whether the input image is enlarged or not; and 

image generation means for selecting 
either the contour vector data obtained by said 
contour extraction means or the contour vector 
data smoothed by said smoothing means accord- 
ing to the results of the determination of said de- 
termination means and for generating an en- 
larged or reduced image on the basis of the se- 
lected contour vector data. 

46. An image processing apparatus according to 
claim 45, wherein said determination means 
makes the determination on the basis of an in- 
struction from an operator. 

47. An image processing apparatus according to 
claim 45, wherein said determination means 
makes the determination by comparing an output 
resolution of said predetermined device with a re- 
solution of the input image. 

48. An image processing apparatus according to 
claim 45, wherein said predetermined device is a 
facsimile apparatus connected to a communica- 
tion line. 



ed in advance of and beyond the irregularity; and 
means for allowing for a slanting vector by 
deleting a plurality of vertical or horizontal vectors 
in the predetermined number of vectors on the 

5 basis of a length and a direction of each of the 

consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of the remaining vectors, 

said second smoothing means including: 

10 means for correcting the starting or end- 

ing point position of the single vector in the con- 
secutive vector data smoothed by said first 
smoothing means except for the point which is 
not determined as the object of smoothing by 

15 said discrimination means by calculating a 
weighted means of the starting or ending point 
coordinates of the plurality of vectors located in 
advance of beyond the single vector. 

20 50. An image processing method in which image 
data is input and output to a predetermined de- 
vice, said method comprising the steps of: 

extracting contour vector data along an 
edge of the input image; 

25 smoothing the contour vector data extract- 

ed by said contour extraction step; 

determining whether the input image is 
enlarged or not; and 

selecting either the contour vector data 

30 obtained by said contour extraction step or the 

contour vector data smoothed by said smoothing 
step according to the results of the determination 
of said determination step and for generating an 
enlarged or reduced image on the basis of the se- 

35 lected contour vector data. 



49. An image processing apparatus according to 
claim 45, wherein said smoothing means in- 
cludes first smoothing means and second 
smoothing means, 40 
said first smoothing means including: 
discrimination means for discriminating a 
point position which is not an object of smoothing 
on the basis of the connection relation between 
the predetermined number of consecutive vec- 45 
tors in the vector data extracted by said contour 
extraction means; 

deletion means for deleting t he vector data 
which forms a closed-loop extracted by said con- 
tour extraction means when the vector data has so 
a size smaller than or equal to a predetermined 
size; 

connecting means for deleting the vector 
data which forms an irregularity having a size 
smaller than or equal to a predetermined size 55 
when the irregularity is present within a region 
having a predetermined length in the extracted 
vector data and for connecting the vectors locat- 



51. An image processing method according to claim 
50, wherein said determination step is performed 
on the basis of an instruction from an operator. 

52. An image processing method according to claim 
45, wherein said determination step is performed 
by comparing an output resolution of said prede- 
termined device with a resolution of the input im- 
age. 

53. An image processing method according to claim 
50, wherein said predetermined device is a fac- 
simile apparatus connected to a communication 
line. 

54. An image processing method according to claim 
50, wherein said smoothing step includes a first 
smoothing step and a second smoothing step, 

said first smoothing step including the 
steps of. 

discriminating a point position which is not 
an object of smoothing on the basis of the con- 



BNSDOCID: <EP 0554985A2_L> 



49 



EP0 554 985 A2 



50 



nection relation between the predetermined 
number of consecutive vectors in the vector data 
extracted by said contour extraction step; 

deleting the vector data which forms a 
closed-loop extracted by said contour extraction 
step when the vector data has a size smaller than 
or equal to a predetermined size; 

deleting the vector data which forms an ir- 
regularity having a size smaller than or equal to 
a predetermined size when the irregularity is 
present within a region having a predetermined 
length in the extracted vector data and for con- 
necting the vectors located in advance of and be- 
yond the irregularity; and 

allowing for a slanting vector by deleting a 
plurality of vertical or horizontal vectors in the 
predetermined number of vectors on the basis of 
a length and a direction of each of the consecu- 
tive predetermined number of vectors and by cor- 
recting a starting or ending coordinate position of 
each of the remaining vectors, 

said second smoothing step including the 
steps of: 

correcting the starting or ending point pos- 
ition of the single vector in the consecutive vector 
data smoothed by said first smoothing step ex- 
cept for the point which is not determined as the 
object of smoothing by said discrimination step 
by calculating a weighted means of the starting or 
ending point coordinates of the plurality of vec- 
tors located in advance of beyond the single vec- 
tor. 

55. An image processing apparatus comprising: 

input means for inputting an image; 

determination means for determining 
whet her a notched portion in the image data input 
by said input means is removed or not on the ba- 
sis of a resolution of the input image; and 

notch removal means for removing the 
notched portion in the input image on the basis 
of the results of the determination of said deter- 
mination means. 

56. An image processing apparatus according to 
claim 55, wherein said input means is image read- 
ing means, and wherein said determination 
means performs the determination on the basis 
of a reading resolution of said image reading 
means. 

57. An image processing apparatus according to 
claim 55, further comprising contour extraction 
means for extracting contour vector data along an 
edge of the image input by said input means, and 

smoothing means for smoothing the con- 
tour vector extracted by said contour extraction 
means, 



said notch removal means removing the 
notched portion in the image data which has 
been smoothed by said smoothing means. 

5 58. An image processing apparatus according to 
claim 57, wherein said smoothing means in- 
cludes first smoothing means and second 
smoothing means, 

said first smoothing means including: 

10 a second determination means for dis- 

criminating a point position which is not an object 
of smoothing on the basis of the connection re- 
lation between a predetermined number of con- 
secutive vectors in the vector data extracted by 

15 said contour extraction means; and 

means for allowing for a slanting vector by 
deleting a plurality of vertical or horizontal vectors 
in the predetermined number of vectors on the 
basis of a length and a direction of each of the 

20 consecutive predetermined number of vectors 
and by correcting a starting or ending coordinate 
position of each of the remaining vectors, 

said second smoothing means including: 
means for correcting the starting or end- 

25 ing point position of the single vector in the con- 

secutive vector data smoothed by said first 
smoothing means except for the point which is 
not determined as the object of smoothing by 
said second determination means by calculating 

30 a weighted means of the starting or ending point 

coordinates of the plurality of vectors located in 
advance of beyond the single vector. 

59. An image processing method in which an outline 
35 of an image, which is drawn on an original, is ex- 
tracted from the original and in which an image re- 
production output is performed on the basis of 
the outline, said method comprising: 

a first instruction step of instructing a re- 
40 solution at which the original is read; 

a second instruction step of instructing 
notch removal when the image is reproduced on 
the basis of the outline; 

a reading step of reading the original ac- 
45 cording to the instruction of said first instruction 
step; 

an outline extraction step of extracting the 
outline of the image data read in said reading step 
and of outputting an outline vector; 
so a notch removal step of performing notch 

removal on the outline vector according to the in- 
struction of said first instruction step or said sec- 
ond instruction step; and 

a reproduction/output step of reproducing 
55 an image from the outline vector and of outputting 
the reproduced image. 

60. An image processing apparatus comprising: 

26 
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reading means for reading an image orig- 
inal; 

instruction means for instructing a resolu- 
tion at which the image original is read by said 
reading means; 5 

outline means for extracting an outline of 
the image data read by said reading means and 
for outputting an outline vector; 

notch removal means for performing notch 
removal on the outline vector on the basis of the 10 
instruction of said instruction means; and 

reproduction/output means for reproduc- 
ing an image from the outline vector and for out- 
putting the reproduced image. 

15 

61. An image processing apparatus comprising: 

reading means for reading an image orig- 
inal; 

outline means for extracting an outline of 
the image data read by said reading means and 20 
for outputting an outline vector; 

instruction means for instructing that 
notch removal be performed on the outline vec- 
tor; 

notch removal means for performing notch 25 
removal on the outline vector on the basis of the 
instruction of said instruction means; and 

reproduction/output means for reproduc- 
ing an image from the outline vector and for out- 
putting the reproduced image. 30 

62. A method of image processing or an image proc- 
essing method, characterised in that contourvec- 
tors are derived from an image edge, defined by 
binary image data, to effect size modification to 35 
said image data. 

63. A method or apparatus according to claim 62, 
wherein the binary image data is separated from 
halftone data forming part of an image. 40 

64. A method or apparatus according to claim 62, 
wherein an enlargement of the image is effected 
by use of said contour vectors. 
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FIG. 26 
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